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Preface 


This text is intended for the introductory three- or four-hour one-semester sopho- 
more level differential equations course traditionally taken by students majoring 
in science or engineering. The prerequisite is the standard course in elementary 
calculus. 

Engineering students frequently take a course on and use the Laplace transform 
as an essential tool in their studies. In most differential equations texts, the Laplace 
transform is presented, usually toward the end of the text, as an alternative method 
for the solution of constant coefficient linear differential equations, with particular 
emphasis on discontinuous or impulsive forcing functions. Because of its placement 
at the end of the course, this important concept is not as fully assimilated as one 
might hope for continued applications in the engineering curriculum. Thus, a goal 
of the present text is to present the Laplace transform early in the text, and use it 
as a tool for motivating and developing much of the remaining differential equation 
concepts for which it is particularly well suited. 

There are several rewards for investing in an early development of the Laplace 
transform. The standard solution methods for constant coefficient linear differential 
equations are immediate and simplified. We are able to provide a proof of the 
existence and uniqueness theorems which are not usually given in introductory texts. 
The solution method for constant coefficient linear systems is streamlined, and we 
avoid having to introduce the notion of a defective or nondefective matrix or develop 
generalized eigenvectors. Even the Cayley—Hamilton theorem, used in Sect. 9.6, is 
a simple consequence of the Laplace transform. In short, the Laplace transform is 
an effective tool with surprisingly diverse applications. 

Mathematicians are well aware of the importance of transform methods to 
simplify mathematical problems. For example, the Fourier transform is extremely 
important and has extensive use in more advanced mathematics courses. The 
wavelet transform has received much attention from both engineers and mathe- 
maticians recently. It has been applied to problems in signal analysis, storage and 
transmission of data, and data compression. We believe that students should be 
introduced to transform methods early on in their studies and to that end, the Laplace 
transform is particularly well suited for a sophomore level course in differential 
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equations. It has been our experience that by introducing the Laplace transform 
near the beginning of the text, students become proficient in its use and comfortable 
with this important concept, while at the same time learning the standard topics in 
differential equations. 

Chapter | is a conventional introductory chapter that includes solution techniques 
for the most commonly used first order differential equations, namely, separable and 
linear equations, and some substitutions that reduce other equations to one of these. 
There are also the Picard approximation algorithm and a description, without proof, 
of an existence and uniqueness theorem for first order equations. 

Chapter 2 starts immediately with the introduction of the Laplace transform as 
an integral operator that turns a differential equation in ¢ into an algebraic equation 
in another variable s. A few basic calculations then allow one to start solving some 
differential equations of order greater than one. The rest of this chapter develops 
the necessary theory to be able to efficiently use the Laplace transform. Some 
proofs, such as the injectivity of the Laplace transform, are delegated to an appendix. 
Sections 2.6 and 2.7 introduce the basic function spaces that are used to describe the 
solution spaces of constant coefficient linear homogeneous differential equations. 

With the Laplace transform in hand, Chap. 3 efficiently develops the basic theory 
for constant coefficient linear differential equations of order 2. For example, the 
homogeneous equation q(D)y = 0 has the solution space €, that has already 
been described in Sect. 2.6. The Laplace transform immediately gives a very easy 
procedure for finding the test function when teaching the method of undetermined 
coefficients. Thus, it is unnecessary to develop a rule-based procedure or the 
annihilator method that is common in many texts. 

Chapter 4 extends the basic theory developed in Chap.3 to higher order 
equations. All of the basic concepts and procedures naturally extend. If desired, one 
can simultaneously introduce the higher order equations as Chap. 3 is developed or 
very briefly mention the differences following Chap. 3. 

Chapter 5 introduces some of the theory for second order linear differential equa- 
tions that are not constant coefficient. Reduction of order and variation of parameters 
are topics that are included here, while Sect.5.4 uses the Laplace transform to 
transform certain second order nonconstant coefficient linear differential equations 
into first order linear differential equations that can then be solved by the techniques 
described in Chap. |. 

We have broken up the main theory of the Laplace transform into two parts 
for simplicity. Thus, the material in Chap. 2 only uses continuous input functions, 
while in Chap.6 we return to develop the theory of the Laplace transform for 
discontinuous functions, most notably, the step functions and functions with jump 
discontinuities that can be expressed in terms of step functions in a natural way. 
The Dirac delta function and differential equations that use the delta function are 
also developed here. The Laplace transform works very well as a tool for solving 
such differential equations. Sections 6.6—6.8 are a rather extensive treatment of 
periodic functions, their Laplace transform theory, and constant coefficient linear 
differential equations with periodic input function. These sections make for a good 
supplemental project for a motivated student. 
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Chapter 7 is an introduction to power series methods for linear differential 
equations. As a nice application of the Frobenius method, explicit Laplace inversion 
formulas involving rational functions with denominators that are powers of an 
irreducible quadratic are derived. 

Chapter 8 is primarily included for completeness. It is a standard introduction to 
some matrix algebra that is needed for systems of linear differential equations. For 
those who have already had exposure to this basic algebra, it can be safely skipped 
or given as supplemental reading. 

Chapter 9 is concerned with solving systems of linear differential equations. 
By the use of the Laplace transform, it is possible to give an explicit formula for 
the matrix exponential e4’ = £7! {(sI = A)" that does not involve the use of 
eigenvectors or generalized eigenvectors. Moreover, we are then able to develop 
an efficient method for computing e“’ known as Fulmer’s method. Another thing 
which is somewhat unique is that we use the matrix exponential in order to solve a 
constant coefficient system y’ = Ay + f(t), y(to) = yo by means of an integrating 
factor. An immediate consequence of this is the existence and uniqueness theorem 
for higher order constant coefficient linear differential equations, a fact that is not 
commonly proved in texts at this level. 

The text has numerous exercises, with answers to most odd-numbered exercises 
in the appendix. Additionally, a student solutions manual is available with solutions 
to most odd-numbered problems, and an instructors solution manual includes 
solutions to most exercises. 


Chapter Dependence 


The following diagram illustrates interdependence among the chapters. 
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Suggested Syllabi 


The following table suggests two possible syllabi for one semester courses. 


3-Hour Course 4-Hour Course Further Reading 

Sections 1.1—1.6 Sections 1.1—1.7 

Sections 2.1—2.8 Sections 2.1—2.8 

Sections 3.1—3.6 Sections 3.1—3.7 

Sections 4.1-4.3 Sections 4.1—4.4 Section 4.5 

Sections 5.1—5.3, 5.6 Sections 5.1-5.6 

Sections 6.1—6.5 Sections 6.1-6.5 Sections 6.6—6.8 
Sections 7.1—7.3 Section 7.4 

Sections 9.1—9.5 Sections 9.1—9.5, 9.7 Section 9.6 


Sections A.1, A.5 


Chapter 8 is on matrix operations. It is not included in the syllabi given above 
since some of this material is sometimes covered by courses that precede differential 
equations. Instructors should decide what material needs to be covered for their 
students. The sections in the Further Reading column are written at a more advanced 
level. They may be used to challenge exceptional students. 

We routinely provide a basic table of Laplace transforms, such as Tables 2.6 
and 2.7, for use by students during exams. 
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Chapter 1 
First Order Differential Equations 


1.1 An Introduction to Differential Equations 


Many problems of science and engineering require the description of some 
measurable quantity (position, temperature, population, concentration, electric 
current, etc.) as a function of time. Frequently, the scientific laws governing such 
quantities are best expressed as equations that involve the rate at which that quantity 
changes over time. Such laws give rise to differential equations. Consider the 
following three examples: 


Example 1 (Newton’s Law of Heating and Cooling). Suppose we are interested 
in the temperature of an object (e.g., a cup of hot coffee) that sits in an environment 
(e.g., a room) or space (called, ambient space) that is maintained at a constant 
temperature 7,. Newton’s law of heating and cooling states that the rate at which 
the temperature T(t)of the object changes is proportional to the temperature 
difference between the object and ambient space. Since rate of change of T(t) is 
expressed mathematically as the derivative, T’(t),! Newton’s law of heating and 
cooling is formulated as the mathematical expression 


T’(t) =r(T(t) —Th), 


where r is the constant of proportionality. Notice that this is an equation that relates 
the first derivative T’(t) and the function T (f) itself. It is an example of a differential 
equation. We will study this example in detail in Sect. 1.3. 


Example 2 (Radioactive decay). Radioactivity results from the instability of the 
nucleus of certain atoms from which various particles are emitted. The atoms then 


‘In this text, we will generally use the prime notation, that is, y’, y”, y’” (and y™ for derivatives 


24) 
of order greater than 3) to denote derivatives, but the Leibnitz notation ay 


> » qr etc. will also be 
used when convenient. 
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decay into other isotopes or even other atoms. The law of radioactive decay states 
that the rate at which the radioactive atoms disintegrate is proportional to the total 
number of radioactive atoms present. If N(t) represents the number of radioactive 
atoms at time f, then the rate of change of N(t) is expressed as the derivative N’(t). 
Thus, the law of radioactive decay is expressed as the equation 


N'(t) = -AN(t). 


As in the previous example, this is an equation that relates the first derivative N’(t) 
and the function N(t) itself, and hence is a differential equation. We will consider it 
further in Sect. 1.3. 


As a third example, consider the following: 


Example 3 (Newton’s Laws of Motion). Suppose s(t) is a position function of 
some body with mass m as measured from some fixed origin. We assume that as 
time passes, forces are applied to the body so that it moves along some line. Its 
velocity is given by the first derivative, s’(t), and its acceleration is given by the 
second derivative, s”(t). Newton’s second law of motion states that the net force 
acting on the body is the product of its mass and acceleration. Thus, 


ms" (t) = Fre(). 


Now in many circumstances, the net force acting on the body depends on time, the 
object’s position, and its velocity. Thus, Fhe (t) = F(t, s(t), s’(t)), and this leads to 
the equation 


ms" (t) = F(t, s(t), s’(t)). 


A precise formula for F depends on the circumstances of the given problem. 
For example, the motion of a body in a spring-body-dashpot system is given by 
ms" (t) + ws’ (t) + ks(t) = f(t), where yz and k are constants related to the spring 
and dashpot and f(t) is some applied external (possibly) time-dependent force. We 
will study this example in Sect. 3.6. For now though, we just note that this equation 
relates the second derivative to the function, its derivative, and time. It too is an 
example of a differential equation. 
Each of these examples illustrates two important points: 


¢ Scientific laws regarding physical quantities are frequently expressed and best 
understood in terms of how that quantity changes. 

¢ The mathematical model that expresses those changes gives rise to equations that 
involve derivatives of the quantity, that is, differential equations. 


We now give a more formal definition of the types of equations we will be studying. 
An ordinary differential equation is an equation relating an unknown function 
y(t), some of the derivatives of y(t), and the variable t, which in many applied 
problems will represent time. The domain of the unknown function is some interval 
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of the real line, which we will frequently denote by the symbol J.” The order 
of a differential equation is the order of the highest derivative that appears in the 
differential equation. Thus, the order of the differential equations given in the above 
examples is summarized in the following table: 


Differential equation Order 
T'(t) =r(T(t) — T,) 1 
N’(t) = —AN(t) 1 
ms’ (t) = F(t, s(t), 8’(t)) 2 


Note that y(¢) is our generic name for an unknown function, but in concrete cases, 
the unknown function may have a different name, such as T(t), M(t), or s(t) in the 
examples above. The standard form for an ordinary differential equation is obtained 
by solving for the highest order derivative as a function of the unknown function 
y = y(t), its lower order derivatives, and the independent variable t. Thus, a first 
order ordinary differential equation is expressed in standard form as 


yO) = Fe y@), (1) 
a second order ordinary differential equation in standard form is written 
yO = FC yO, y'O), (2) 
and an nth order differential equation is expressed in standard form as 
yO = Fe yO, ... YP). (3) 


The standard form is simply a convenient way to be able to talk about various 
hypotheses to put on an equation to insure a particular conclusion, such as existence 
and uniqueness of solutions (discussed in Sect. 1.7) and to classify various types 
of equations (as we do in this chapter, for example) so that you will know which 
algorithm to apply to arrive at a solution. In the examples given above, the equations 


T'(t) = r(T@) - Th), 
N'(t) = -AN(t) 


are in standard form while the equation in Example 3 is not. However, simply 
dividing by m gives 


1 
0) = 4 FU, 8. 8). 


a second order differential equation in standard form. 


Recall that the standard notations from calculus used to describe an interval I are (a, b), [a, ), 
(a, b], and [a, b] where a < b are real numbers. There are also the infinite length intervals 
(—oo, a) and (a, oo) where a is a real number or oo. 


4 1 First Order Differential Equations 


In differential equations involving the unknown function y(t), the variable ¢ is 
frequently referred to as the independent variable, while y is referred to as the 
dependent variable, indicating that y has a functional dependence on f. In writing 
ordinary differential equations, it is conventional to suppress the implicit functional 
evaluations y(t), y’(t), etc. and write y, y’, etc. Thus the differential equations in 
our examples above would be written 


T’ =r(T—T,), 
N’=-AN, 
” 1 / 
and s” = —Fi(t, s,s’), 
m 
where the dependent variables are respectively, T, N, and s. 
Sometimes we must deal with functions u = u(t), fo, ..., t,) of two or more 

variables. In this case, a partial differential equation is an equation relating u, 
some of the partial derivatives of u with respect to the variables t,, ..., t,, and 


possibly the variables themselves. While there may be a time or two where we 
need to consider a partial differential equation, the focus of this text is on the 
study of ordinary differential equations. Thus, when we use the term differential 
equation without a qualifying adjective, you should assume that we mean ordinary 
differential equation. 


Example 4. Consider the following differential equations. Determine their order, 
whether ordinary or partial, and the standard form where appropriate: 


1. y' = 2y 2.y'-y=t 

3. y” +siny =0 4, yA —y" = y 
a 0? 

5.ay” + by'’+cy =Acoswt (a#0) cee keen, 
ox2 dy? 


> Solution. Equations (1)-(5) are ordinary differential equations while (6) is a 
partial differential equation. Equations (1) and (2) are first order, (3) and (5) are 
second order, and (4) is fourth order. Equation (1) is in standard form. The standard 
forms for (2)—(5) are as follows: 


2.y=yH+t 3.y” = —siny 
b c A 
4AyO=y"+y 5.y"=——y’—-y+—cosot < 
a a a 
Solutions 


In contrast to algebraic equations, where the given and unknown objects are 
numbers, differential equations belong to the much wider class of functional 
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equations in which the given and unknown objects are functions (scalar functions or 
vector functions) defined on some interval. A solution of an ordinary differential 
equation is a function y(t) defined on some specific interval J C R such that 
substituting y(t) for y and substituting y’(t) for y’, y”(t) for y”, etc. in the 
equation gives a functional identity. That is, an identity which is satisfied for all 
t € I. For example, if a first order differential equation is given in standard form as 
y’ = F(t, y), then a function y(t) defined on an interval J is a solution if 


y(t) = F(t, y(t) forallt € J. 


More generally, y(t), defined on an interval J, is a solution of an nth order 
differential equation expressed in standard form by y” = F(t, y, y’, ...,y7)) 
provided 


yMt) = F(t, y(t), ..., YP @) _ forallt € /. 


It should be noted that it is not necessary to express the given differential equation 
in standard form in order to check that a function is a solution. Simply substitute 
y(t) and the derivatives of y(t) into the differential equation as it is given. The 
general solution of a differential equation is the set of all solutions. As the following 
examples will show, writing down the general solution to a differential equation can 
range from easy to difficult. 


Example 5. Consider the differential equation 
yoy-t. (4) 


Determine which of the following functions defined on the interval (—oo, oo) are 
solutions: 


l. yi(@t)=tt+1 

2. y(t) =e 

3. y3(t) =t+1-—Te' 

4, y4(t) = t + 1+ ce! where c is an arbitrary scalar. 


> Solution. In each case, we calculate the derivative and substitute the results in 
(4). The following table summarizes the needed calculations: 


Function y(t) y(t)—-t 
y(t) =tt+1 yi) =1 y(t) -t=t+1-t=1 
y(t) =e! y3(t) =e! yo(t)—t =e'—1t 


y3(t) =t+1—-Te y§t)=1—-Te y3(t) -—t =t+1—7e' —t =1-—Te' 


yat) =t+ 1tce yh(th=1lt+ce yt) —-t=t+1+ce-t=1+ce! 


For y;(t) to be a solution of (4), the second and third entries in the row for y;(t) 
must be the same. Thus, y;(t), y3(t), and y4(t) are solutions while y(t) is not a 
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Fig. 1.1 The solutions 
ye(t) =t +1+ ce! of 
y’ = y—t for various c 


solution. Notice that y,(¢) = y4(t) when c = O and y3(t) = y4(t) whenc = —7. 
Thus, y4(t) actually already contains y;(t) and y3(t) by appropriate choices of the 
constant c € R, the real numbers. < 


The differential equation given by (4) is an example of a first order linear 
differential equation. The theory of such equations will be discussed in Sect. 1.4, 
where we will show that all solutions to (4) are included in the function 


ya(t) =t+1+4 ce’, t € (—00, 00) 


of the above example by appropriate choice of the constant c. We call this the 
general solution of (4) and denote it by y,(t). Figure 1.1 is the graph of y,(t) for 
various choices of the constant c. 

Observe that the general solution is parameterized by the constant c, so that there 
is a solution for each value of c and hence there are infinitely many solutions of 
(4). This is characteristic of many differential equations. Moreover, the domain is 
the same for each of the solutions, namely, the entire real line. With the following 
example, there is a completely different behavior with regard to the domain of the 
solutions. Specifically, the domain of each solution varies with the parameter c and 
is not the same interval for all solutions. 


Example 6. Consider the differential equation 
y Sal yy, (5) 
Show that the following functions are solutions: 


Lyi) =-1 
2. yo(t) = —1 + (t? — cc)“, for any constant c 
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Fig. 1.2. The solutions y(t) = —1 + (t? —c)7! of y’ = —2t(1 + y)? for various c 


> Solution. Let y;(¢) = —1. Then yj (t) = 0 and —2r(1 + yi(¢))? = —22(0) = 0, 


which is valid for all t € (—oo, co). Hence, y;(t) = —1 is a solution. 
Now let y2(t) = —1 + (¢? —c)7!. Straightforward calculations give 
y3(t) = —2t(t? —c)~?, and 


—2t(1 + y(t))? = —24(1 + (-14+ (@ —c)7!))? = -20(t? — cc). 


Thus, y(t) = —2t(1 + yo(t))? so that yo(¢) is a solution for any choice of the 
constant c. < 


Equation (5) is an example of a separable differential equation. The theory of 
separable equations will be discussed in Sect. 1.3. It turns out that there are no 
solutions to (5) other than y(t) and y(t), so that these two sets of functions 
constitute the general solution y,(t). Notice that the intervals on which y(t) is 
defined depend on the constant c. For example, if c < 0, then y2(t) = —1 + (¢? — 
c)~! is defined for all t € (—o0, 00). If c = 0, then y2(t) = —1 +t? is defined on 
two intervals: t € (—oo, 0) or t € (0, 00). Finally, if c > 0, then y(t) is defined on 
three intervals: (—oo, —./c), (-/c, Vc), or (./c, 00). Figure 1.2 gives the graph 
of y2(t) for various choices of the constant c. 

Note that the interval on which the solution y(t) is defined is not at all apparent 
from looking at the differential equation (5). 


Example 7. Consider the differential equation 
y” + l6y =0. (6) 
Show that the following functions are solutions on the entire real line: 


1. y\(t) = cos 4t 
2. yo(t) = sin 4t 
3. y3(t) = c cos 4t + cz sin 4t, where c; and cp are constants. 


Show that the following functions are not solutions: 


4. y4(t) = e* 
5. ys(t) = sint. 
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> Solution. In standard form, (6) can be written as y” = —16y, so for y(t) to be 
a solution of this equation means that y”(t) = —16y(t) for all real numbers f. The 
following calculations then verify the claims for the functions y;(t), 1 <i <5): 
LoS Laer = La eres = —l6cos4t = —16y,(t) 
dt? dt 

; a d 
2. y3(t) = qy2 sin 4t) = eo 4t) = —16sin4t = —16y2(t) 
3. VW) = Fee cos 4t + c2 sin4t) = © (4c sin 4t + 4c) cos 4f) 


= —16c; cos 4t — 16c2 sin 4t = —16y3(t) 


d? d 
4. yi = a (e“) = 7 (4e*') = 16e*’ 4 —16y4(t) 


d2 

5. y(t) = — 
V5 ( ) dt2 

It is true, but not obvious, that letting c; and c> vary over all real numbers in y3(t) = 
c, cos 4t + cy sin 4t produces all solutions to y” + 16y = 0, so that y3(f) is the 
general solution of (6) . This differential equation is an example of a second order 


constant coefficient linear differential equation. These equations will be studied in 
Chap. 3. 


d 
(sint) = a 8 t) = —sint 4 —l6ys(t) <4 


The Arbitrary Constants 


In Examples 5 and 6, we saw that the solution set of the given first order equation 
was parameterized by an arbitrary constant c (although (5) also had an extra solution 
yi(t) = —1), and in Example 7, the solution set of the second order equation 
was parameterized by two constants c; and c2. To understand why these results are 
not surprising, consider what is arguably the simplest of all first order differential 
equations: 


y' = f(t), 


where f(t) is some continuous function on some interval 7. Integration of both 
sides produces a solution 


v0) = / fit Re: (7) 


where c is a constant of integration and f f(t) dt is any fixed antiderivative of f(t). 
The fundamental theorem of calculus implies that all antiderivatives are of this form 
so (7) is the general solution of y’ = f(t). Generally speaking, solving any first 
order differential equation will implicitly involve integration. A similar calculation 
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for the differential equation 
y" =f) 


gives y(t) = f f(t) dt + c; so that a second integration gives 


v= f oauta= | (f fora) dt + c2 
=| (f roa) dt + cit + ¢9, 


where c; and c> are arbitrary scalars. The fact that we needed to integrate twice 
explains why there are two scalars. It is generally true that the number of parameters 
(arbitrary constants) needed to describe the solution set of an ordinary differential 
equation is the same as the order of the equation. 


Initial Value Problems 


As we have seen in the examples of differential equations and their solutions 
presented in this section, differential equations generally have infinitely many 
solutions. So to specify a particular solution of interest, it is necessary to specify 
additional data. What is usually convenient to specify for a first order equation 
is an initial value f of the independent variable and an initial value y(t) for 
the dependent variable evaluated at f). For a second order equation, one would 
specify an initial value fo for the independent variable, together with an initial value 
y(t) and an initial derivative y’(to) at fo. There is an obvious extension to higher 
order equations. When the differential equation and initial values are specified, one 
obtains what is known as an initial value problem. Thus, a first order initial value 
problem in standard form is 


y'= F(t, y), y(lo) = yo, (8) 
while a second order equation in standard form is written 


y"=F(t,y, y’), yo) =yo, y(t) =. (9) 


Example 8. Determine a solution to each of the following initial value problems: 


l.y’=y-t, y(0)=-3 
2. y”=2-6r, y(0)=-l, y’(0)=2 
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> Solution. 

1. Recall from Example 5 that for each c € R, the function y(t) = t + 1+ ce’ 
is a solution for y’ = y —¢. This is the function y4(t) from Example 5. Thus, 
our strategy is just to try to match one of the constants c with the required initial 
condition y(0) = —3. Thus, 

—3= y(0) =1+ce°=1+4+c 
requires that we take c = —4. Hence, 
y(t) =t+1—4e’ 
is a solution of the initial value problem. 

2. The second equation is asking for a function y(t) whose second derivative is the 

given function 2 — 6f. But this is precisely the type of problem we discussed 


earlier and that you learned to solve in calculus using integration. Integration of 
y” gives 


y(t) = [roe +o= [e- 6t) dt +c; = 2t—30? +c, 
and evaluating at t = 0 gives the equation 
2= y'(0) = (2t-— 317 + ¢1)|,— =}. 
Thus, c; = 2 and y/(t) = 2 — 3t? + 2. Now integrate again to get 
y= [roe = [e+ 2t — 3t7) dt = 21 + 2? — 27 + e9, 
and evaluating at t = 0 gives the equation 
-1 = y(0) = (2¢+1?-1? +.c)|,_, = co. 


Hence, co = —1 and we get y(t) = —1 + 2t + 2? — £3 as the solution of our 
second order initial value problem. < 


Some Concluding Comments 


Because of the simplicity of the second order differential equation in the previous 
example, we indicated a rather simple technique for solving it, namely, integration 
repeated twice. This was not possible for the other examples, even of first order 
equations, due to the functional dependencies between y and its derivatives. In 
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general, there is not a single technique that can be used to solve all differential 
equations, where by solve we mean to find an explicit functional description of 
the general solution yg(t) as an explicit function of t, possibly depending on 
some arbitrary constants. Such a yg(t) is sometimes referred to as a closed form 
solution. There are, however, solution techniques for certain types or categories 
of differential equations. In this chapter, we will study categories of first order 
differential equations such as: 


¢ Separable 

e Linear 

¢ Homogeneous 
¢ Bernoulli 

e Exact 


Each category will have its own distinctive solution technique. For higher order 
differential equations and systems of first order differential equations, the concept 
of linearity will play a very central role for it allows us to write the general solution 
in a concise way, and in the constant coefficient case, it will allow us to give a 
precise prescription for obtaining the solution set. This prescription and the role of 
the Laplace transform will occupy the two main important themes of the text. The 
role of the Laplace transform will be discussed in Chap. 2. In this chapter, however, 
we Stick to a rather classical approach to first order differential equations and, in 
particular, we will discuss in the next section direction fields which allow us to give 
a pictorial explanation of solutions. 
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Exercises 


1-3. In each of these problems, you are asked to model a scientific law by means 
of a differential equation. 


1. 


Malthusian Growth Law. Scientists who study populations (whether popula- 
tions of people or cells in a Petri dish) observe that over small periods of time, 
the rate of growth of the population is proportional to the population present. 
This law is called the Malthusian growth law. Let P(t) represent the number 
of individuals in the population at time t. Assuming the Malthusian growth law, 
write a differential equation for which P(t) is the solution. 


. The Logistic Growth Law. The Malthusian growth law does not account for 


many factors affecting the growth of a population. For example, disease, 
overcrowding, and competition for food are not reflected in the Malthusian 
model. The goal in this exercise is to modify the Malthusian model to take 
into account the birth rate and death rate of the population. Let P(t) denote the 
population at time ¢. Let b(t) denote the birth rate and d(t) the death rate at 
time f. 


(a) Suppose the birth rate is proportional to the population. Model this state- 
ment in terms of b(t) and P(t). 

(b) Suppose the death rate is proportional to the square of the population. 
Model this statement in terms of d(t) and P(t). 

(c) The logistic growth law states that the overall growth rate is the difference 
of the birth rate and death rate, as given in parts (a) and (b). Model this law 
as a differential equation in P(r). 


. Torricelli’s Law. Suppose a cylindrical container containing a fluid has a drain 


on the side. Torricelli’s law states that the change in the height of the fluid 
above the middle of the drain is proportional to the square root of the height. 
Let h(t) denote the height of the fluid above the middle of the drain. Determine 
a differential equation in h(t) that models Torricelli’s law. 


4-11. Determine the order of each of the following differential equations. Write the 
equation in standard form. 


12- 


yy! = a 
yly" = a 
toy! +ty= ef 


. ty" +ty’+3y =0 

.3y' + 2y+ y= 0? 

. t(yOy + (y"”)4 =| 

: y’ a try = ty4 

. y= Dy" Sy! = y =0 


18. Following each differential equation are four functions y,, ... , y4. 


Determine which are solutions to the given differential equation. 


12. 


13. 


14. 


15. 


16. 


17. 


18. y 


y’ =2y 


(a) yi(t) =0 
(b) yo(t) = 07 
(c) y3(t) = 3e7" 
(d) ya(t) = 2e*% 


ty =y 

(a) yi(t) =0 

(b) yo(t) = 3t 

(c) y3(¢t) = —St 

(d) ya(t) = 03 

y" +4y =0 

(a) yi(t) =e 

(b) yo(t) = sin 2t 

(c) y3(t) = cos(2t — 1) 
(d) ya(t) = 0? 


y’ =2y(y-1) 
(a) yi(t) =0 
(b) yo(t) = 1 

(c) y3(t) =2 
(dd) ys) = te 
2yy'=1 

(a) yi(t) = 1 
(b) y2o(t) =¢ 


(c) y3(t) = Int 
(d) ya(t) = vt—4 


2yyw =y?+t-1 
(a) yi(t) = /-t 

(b) yo(t) = —vVe!’ -t 
(c) y3(t) = Vt 

(d) y4(t) = —J/—t 


_ y? — 4yt + 61? 
=a 
(a) yi(t) =¢ 


(b) yo(t) = 2t 
(c) y3(t) = 3t 


3t + 217 
d t)h= 
(d) ya(t) cy 
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19-25. Verify that each of the given functions y(t) is a solution of the given 
differential equation on the given interval 7. Note that all of the functions depend 
on an arbitrary constant c € R. 


19. y =3y4+12; y(t) =ce*—4, I = (-c,0) 

20. y’ Y + 3t; y(t)=ce'+3t-—3 I= (-—ow,o) 

21. y’=y?-y; y(t) =1/(-ce') I = (-o0, 0) ife < 0,7] = (—-Inc, &) 
ifc > 0 

22. y' =2ty; y(t)= ce, [= (—oo, 00) 

23. y’ =-e’ —1; y(t) = —In(ce’ — 1) withc > 0, J = (—Inc, oo) 

24. (¢+1)y’+y=0; y(t) =ct4+1)', I = (1,00) 

25. y'=y*s y@)=(c-11, I =(Coo,c) 


Ir 


26-31. Solve the following differential equations. 


26. y =t4+3 
27. y =e -1 
28. y' =te* 
29. y= = 
30. y’ = 2t+1 


31. y” = 6sin3t 


32-38. Find a solution to each of the following initial value problems. See 
Exercises 19-31 for the general solutions of these equations. 


ay =3y4+12, yO)=- 

33. y’ me ae. y(0) =0 

34. y= y?—-y, y(0) =1/2 

35. ¢+)y+y=0, yd)=-9 
eam y(0) =4 

37. yo e‘, y(0)=—- 

38. y" = nr y(0) = 1, y’(0) = 2 
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1.2 Direction Fields 


Suppose 
y= F(t, y) () 


is a first order differential equation (in standard form), where F(t, y) is defined in 
some region of the (¢, y)-plane. The geometric interpretation of the derivative of a 
function y(t) at fo as the slope of the tangent line to the graph of y(t) at (to, y(to)) 
provides us with an elementary and often very effective method for the visualization 
of the solution curves (:= graphs of solutions) to (1). The visualization process 
involves the construction of what is known as a direction field or slope field for the 
differential equation. For this construction, we proceed as follows. 


Construction of Direction Fields 


1. Solve the given first order differential equation for y’ to put it in the standard 
form y’ = F(t, y). 
2. Choose a grid of points in a rectangular region 


R={(t, y):a<t<b;ce<y<d} 


in the (t, y)-plane where F(t, y) is defined. This means imposing a graph-paper- 
like grid of vertical lines t = ¢; fora = t) < t2 < +++ < ty = D and horizontal 
lines y = y; forc = yj < yj) < ++: < yy = d. The points (t;, y;) where the 
grid lines intersect are the grid points. 

3. At each point (t, y), the number F(t, y) represents the slope of a solution curve 
through this point. For example, if y’ = y? —t¢ so that F(t, y) = y* —t, then at 
the point (1, 1) the slope is F(1, 1) = 17 — 1 = 0, at the point (2, 1) the slope is 
F(2,1) = 1* —2 = —1, and at the point (1, —2) the slope is F(1, —2) = 3. 

4. Through the grid point (t;, y;), draw a small line segment having the slope 
F(t;, y;). Thus, for the equation y’ = y? — t, we would draw a small line 
segment of slope 0 through (1, 1), slope —1 through (2, 1), and slope 3 through 
(1, —2). With a graphing calculator, one of the computer mathematics programs 
Maple, Mathematica, or MATLAB, or with pencil, paper, and a lot of patience, 
you can draw line segments of the appropriate slope at all of the points of the 
chosen grid. The resulting picture is called a direction field for the differential 
equation y’ = F(t, y). 

5. With some luck with respect to scaling and the selection of the (¢, y)-rectangle 
R, you will be able to visualize some of the line segments running together to 
make a graph of one of the solution curves. 
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Fig. 1.3 Direction field and some solutions for y’ = y — 2 


6. To sketch a solution curve of y' = F(t, y) from a direction field, start with 
a point Po = (to, yo) on the grid, and sketch a short curve through Py with 
tangent slope F (to, yo). Follow this until you are at or close to another grid point 
P, = (th, y1). Now continue the curve segment by using the updated tangent 
slope F(t1, y1). Continue this process until you are forced to leave your sample 
rectangle R. The resulting curve will be an approximate solution to the initial 
value problem y’ = F(t, y), y(to) = yo. Generally speaking, more accurate 
approximations are obtained by taking finer grids. The solutions are sometimes 
called trajectories. 


Example 1. Draw the direction field for the differential equation y’ = y —2. Draw 
several solution curves on the direction field. 


> Solution. We have chosen a rectangle R = {(t, y):-4<t, y < 4} for 
drawing the direction field, and we have chosen to use 16 sample points in each 
direction, which gives a total of 256 grid points where a slope line will be drawn. 
Naturally, this is being done by computer and not by hand. Figure 1.3 gives the 
completed direction field with five solution curves drawn. The solutions that are 
drawn in are the solutions of the initial value problems 


y=y-2, y(0) = yo, 


where the initial value yo is 0, 1, 2, 2.5, and 3, reading from the bottom solution to 
the top. « 


You will note in this example that the line y = 2 is a solution. In general, 
any solution to (1) of the form y(t) = yo, where yo is a constant, is called an 
equilibrium solution. Its graph is called an equilibrium line. Equilibrium solutions 
are those constant functions y(t) = yo determined by the constants yo for 
which F(t, yo) = 0 for all t. For example, Newton’s law of heating and cooling 
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Fig. 1.4 Direction field and some solutions for y’ = —t/y 


(Example | of Sect. 1.1) is modeled by the differential equation T’ = r(T — T,) 
which has an equilibrium solution T(t) = T,. This conforms with intuition since 
if the temperature of the object and the temperature of ambient space are the same, 
then no change in temperature takes place. The object’s temperature is then said to 
be in equilibrium. 


Example 2. Draw the direction field for the differential equation yy’ = —t. Draw 
several solution curves on the direction field and deduce the family of solutions. 


> Solution. Before we can draw the direction field, it is necessary to first put the 
differential equation yy’ = —t¢ into standard form by solving for y’. Solving for y’ 
gives the equation 


yaa, (2) 


Notice that this equation is not defined for y = 0, even though the original equation 
is. Thus, we should be alert to potential problems arising from this defect. Again we 
have chosen a rectangle R = {(t, y): -—4<¢, y < 4} for drawing the direction 
field, and we have chosen to use 16 sample points in each direction. Figure 1.4 
gives the completed direction field and some solutions. The solutions which are 
drawn in are the solutions of the initial value problems yy’ = —t, y(0) = +1, +2, 
+3. The solution curves appear to be circles centered at (0,0). In fact, the family 
of such circles is given by t? + y* = c, where c > 0. We can verify that functions 
determined implicity by the family of circles t? + y? = c are indeed solutions. For, 
by implicit differentiation of the equation t? + y (with respect to the ¢ variable), 
we get 2t + 2yy’ = 0 and solving for y’ gives (2). Solving t? + y* = c implicitly 
for y gives two families of continuous solutions, specifically, y(t) = Vc —t? 
(upper semicircle) and y2(t) = —<Vc—t? (lower semicircle). For both families 
of functions, c is a positive constant and the functions are defined on the interval 
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Fig. 1.5 Graph of 
ft.y)=e 


(—J/c, \/c). For the solutions drawn in Fig. 1.4, the constant ¢ is 1, /2, and J3. 
Notice that, although y; and y2 are both defined for t = +./c, they do not satisfy 
the differential equation at these points since y, and y5 do not exist at these points. 
Geometrically, this is a reflection of the fact that the circle t? + y? = c hasa 
vertical tangent at the points (+./c, 0) on the t-axis. This is the “defect” that you 
were warned could occur because the equation yy’ = —t, when put in standard 
form y’ = —t/y, is not defined for y = 0. < 


Note that in the examples given above, the solution curves do not intersect. This 
is no accident. We will see in Sect. 1.7 that under mild smoothness assumptions on 
the function F(t, y), it is absolutely certain that the solution curves (trajectories) of 
an equation y’ = F(t, y) can never intersect. 


Implicitly Defined Solutions 


Example 2 is one of many examples where solutions are sometimes implicitly de- 
fined. Let us make a few general remarks when this occurs. Consider a relationship 
between the two variables t and y determined by the equation 


f(y) =e. (3) 


We will say that a function y(t) defined on an interval J is implicitly defined by (3) 
provided 


f(t, y@)) =c forallt € J. (4) 


This is a precise expression of what we mean by the statement: 
Solve the equation f(t, y) = for y as a function of t. 


To illustrate, we show in Fig. 1.5 a typical graph of the relation f(t, y) = c, fora 
particular c. We observe that there are three choices of solutions that are continuous 
functions. We have isolated these and call them y,(f), y2(t), and y3(t). The graphs 
of these are shown in Fig. 1.6. Observe that the maximal intervals of definition for 
yi, ¥2, and y3 are not necessarily the same. 
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Graph of y,(t) Graph of yp(t) Graph of y3(t) 


Fig. 1.6 Graphs of functions implicitly defined by f(t, y) = c 


By differentiating* (4) with respect to t (using the chain rule from multiple 
variable calculus), we find 


of of 

5 (t, y(t) + -- yO)y'O = 0. 

ot oy 

Since the constant c is not present in this equation, we conclude that every function 
implicitly defined by the equation f(t, y) = c, for any constant c, is a solution of 
the same first order differential equation 


~4+—~y'=0, (5) 
y 


We shall refer to (5) as the differential equation for the family of curves 
F(t, y) = c. One valuable technique that we will encounter in Sect. 1.6 is that 
of solving a first order differential equation by recognizing it as the differential 
equation of a particular family of curves. 


Example 3. Find the first order differential equation for the family of hyperbolas 
ty=c 
in the (¢, y)-plane. 


> Solution. Implicit differentiation of the equation ty = c gives 
yt+ty’=0 


as the differential equation for this family. In standard form, this equation is y’ = 

—y/t. Notice that this agrees with expectations, since for this simple family ty = c, 
we can solve explicitly to get y = c/t (fort 4 0) so that y’ = —c/t? = —y/t. 

< 

It may happen that it is possible to express the solution for the differential 


equation y’ = F(t, y) as an explicit formula, but the formula is sufficiently 
complicated that it does not shed much light on the nature of the solution. In such 


3In practice, this is just implicit differentiation. 
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Fig. 1.7 Direction field and some solutions for y’ = 


a situation, constructing a direction field and drawing the solution curves on the 
direction field can sometimes give useful insight concerning the solutions. The 
following example is a situation where the picture is more illuminating than the 
formula. 


Example 4. Verify that 
y —4y—0?4+4t =c (6) 
defines an implicit family of solutions to the differential equation 
: 2t—4 
ar ear 
3y?7 — 4 
> Solution. Implicit differentiation gives 


3y2y’ —4y’ -2t +4=0, 


and solving for y’, we get 
_ 2t-4 
~ 3y2— 4" 


/ 


y 


Solving (6) involves a messy cubic equation which does not necessarily shed great 
light upon the nature of the solutions as functions of t. However, if we compute 
21-4 


the direction field of y’ = +24 and use it to draw some solution curves, we see 


information concerning the nature of the solutions that is not easily deduced from 
the implicit form given in (6). For example, Fig. 1.7 gives the direction field and 
some solutions. Some observations that can be deduced from the picture are: 


¢ In the lower part of the picture, the curves seem to be deformed ovals centered 
about the point P ~ (2, —1.5). 

e Above the point Q ~ (2, 1.5), the curves no longer are closed but appear to 
increase indefinitely in both directions. < 
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Exercises 


1-3. For each of the following differential equations, use some computer math 
program to sketch a direction field on the rectangle R = {(t, y):-4<t,y < 4} 
with integer coordinates as grid points. That is, f and y are each chosen from the set 
{—4, -3, —2, -1, 0, 1, 2, 3, 4}. 


l. y'=t 
2. y= y? 
3. Y =y +h) 
4-9. A differential equation is given together with its direction field. One solution 


is already drawn in. Draw the solution curves through the points (¢, y) as indicated. 
Keep in mind that the trajectories will not cross each other in these examples. 
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10-13. For the following differential equations, determine the equilibrium solu- 
tions, if they exist. 


10. 7 Sy" 
_ 

ll. y=y(y +t) 

12. y'=y-t 

13. y’=1-y? 

14. The direction field given in Problem 5 for y’ = y — ¢ suggests that there may 
be a linear solution. That is a solution of the form y = at + b. Find such a 
solution. 

15. Below is the direction field and some trajectories for y’ = cos(y + f). The 
trajectories suggest that there are linear solutions that act as asymptotes for the 
nonlinear trajectories. Find these linear solutions. 

y!=cos(t+y ) y/=cos(t+y ) 
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16-19. Find the first order differential equation for each of the following families 
of curves. In each case, c denotes an arbitrary real constant. 


16. 317+ 4y*=c 
17. y—-1?-—P=c 
18. y=ce* +t 
19. y=cth +r? 
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1.3. Separable Differential Equations 


In the next few sections, we will concentrate on solving particular categories of 
first order differential equations by means of explicit formulas and algorithms. 
These categories of equations are described by means of restrictions on the function 
F(t, y) that appears on the right-hand side of a first order ordinary differential 
equation given in standard form 


y’ = F(t, y). (1) 


The first of the standard categories of first order equations to be studied is the class 
of equations with separable variables, that is, equations of the form 


y’ = h(t)g(y). (2) 


Such an equation is said to be a separable differential equation or just separable, 
for short. Thus, (1) is separable if the right-hand side F(t, y) can be written as a 
product of a function of t and a function of y. Most functions of two variables cannot 
be written as such a product, so being separable is rather special. However, a number 
of important applied problems turn out to be modeled by separable differential 
equations. We will explore some of these at the end of this section and in the 
exercises. 


Example 1. Identify the separable equations from among the following list of 
differential equations: 


ery 2. y=y-y? 
t-—y t 
3, ‘— 4, oo 
yay my 
5. (t-l1Q?-ly'+t-y-l+ty=0 6 y= f(t) 
7. y= p(t)y 8. y” =ty 


> Solution. Equations (1), (2) and (4)-(7) are separable. For example, in (2), 
h(t) = 1 and g(y) = y — y’; in (4), A(t) = t and g(y) = 1/y; and in (6), 
h(t) = f(t) and g(y) = 1. To see that (5) is separable, we bring all terms not 
containing y’ to the other side of the equation, that is, 


Qt-NO?-Dy’ =-t+y+1—-ty=-t0 +y)+1+y=04+y)0—-9). 
Solving this equation for y’ gives 


,_ (i-t) (+y) 
~ @t=1) G?=1) 
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which is separable with h(t) = (1 — t)/(2t — 1) and g(y) = (1+ y)/(Q? — 1). 
Equation (3) is not separable because the right-hand side cannot be written as 
product of a function of ¢ and a function of y. Equation (8) is not a separable 
equation, even though the right-hand side is ty = h(t)g(y), since it is a second 
order equation and our definition of separable applies only to first order equations. 
< 


Equation (2) in the previous example is worth emphasizing since it is typical of 
many commonly occurring separable differential equations. What is special is that 
it has the form 


y’ = g(y), (3) 


where the right-hand side depends only on the dependent variable y. That is, in 
(2), we have h(t) = 1. Such an equation is said to be autonomous or time 
independent. Some concrete examples of autonomous differential equations are 
the law of radioactive decay, N’ = —AN; Newton’s law of heating and cooling, 
T' = r(T —T,); and the logistic growth model equation P’ = (a — bP) P. These 
examples will be studied later in this section. 

To motivate the general algorithm for solving separable differential equations, let 
us first consider a simple example. 


Example 2. Solve 
y’ = -2t(1 + y)’. (4) 


(See Example 6 of Sect. 1.1 where we considered this equation.) 


> Solution. This is a separable differential equation with h(t) = —2t and g(y) = 
(1 + y)?. We first note that y(t) = —1 is an equilibrium solution. (See Sect. 1.2.) 
To proceed, assume y # —1. If we use the Leibniz form for the derivative, y’ = Y 
then (4) can be rewritten as 


dy 2 
— =-2t(1 ; 
a (i+ y) 


Dividing by (1 + y)* and multiplying by dt give 

(1+ y)*dy = —2¢ de. (5) 
Now integrate both sides to get 

(9)? ==? #6, 


where c is the combination of the arbitrary constants of integration from both sides. 
To solve for y, multiply both sides by —1, take the reciprocal, and then add —1. 
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We then get y = —1 + (t? —c)~!, where c is an arbitrary scalar. Remember that we 
have the equilibrium solution y = —1 so the solution set is 


y=-1l+(@-c)", 
y=—l, 


where c € R. > | 


We note that the ¢ and y variables in (5) have been separated by the equal sign, 
which is the origin of the name of this category of differential equations. The left- 
hand side is a function of y times dy and the right-hand side is a function of ¢ times 
dt. This process allows separate integration to give an implicit relationship between 
t and y. This can be done more generally as outlined in the following algorithm. 


Algorithm 3. To solve a separable differential equation, 


y’ =h(@)g(y), 


perform the following operations: 


Solution Method for Separable Differential Equations 


1. Determine the equilibrium solutions. These are all of the constant solutions 
y = yo and are determined by solving the equation g(v) = 0 for yo. 

2. Separate the variables in a form convenient for integration. That is, we 
formally write 


1 
—_dy=h 
g(y) eee 


and refer to this equation as the differential form of the separable 
differential equation. 

3. Integrate both sides, the left-hand side with respect to y and the right-hand 
side with respect to t.* This yields 


which produces the implicit solution 


O(y) = H(t) +e, 


where Q(y) is an antiderivative of 1/g(y) and H(t) is an antiderivative of 
h(t). Such antiderivatives differ by a constant c. 
4. Uf possible, solve the implicit relation explicitly for y.) oO 
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Note that Step 3 is valid as long as the antiderivatives exist on an interval. From 
calculus, we know that an antiderivative exists on an interval as long as the integrand 
is a continuous function on that interval. Thus, it is sufficient that A(t) and g(y) are 
continuous on appropriate intervals in ¢ and y, respectively, and we will also need 
g(y) 4 0 in order for 1/g(y) to be continuous. 

In the following example, please note in the algebra how we carefully track the 
evolution of the constant of integration and how the equilibrium solution is folded 
into the general solution set. 


Example 4. Solve 
y' = 2ty. (6) 


> Solution. This is a separable differential equation: h(t) = 2t and g(y) = y. 
Clearly, y = 0 is an equilibrium solution. Assume now that y 4 0. Then (6) can be 
rewritten as oe = 2ty. Separating the variables by dividing by y and multiplying 
by dt gives 


1 
—dy = 2rdt. 
y 


Integrating both sides gives 
In|y| = 0? + ko, (7) 


where ko is an arbitrary constant. We thus obtain a family of implicitly defined 
solutions y. In this example, we will not be content to leave our answer in this 
implicit form but rather we will solve explicitly for y as a function of t. Carefully 
note the sequence of algebraic steps we give below. This same algebra is needed 
in several examples to follow. We first exponentiate both sides of (7) (remembering 
that e'"* = x for all positive x, and e**” = ee? for all a and b) to get 


; a4 2 2 
ly] = en! =e tko — ekoel = ke! ; (8) 


where k; = e*° is a positive constant, since the exponential function is positive. 
Next we get rid of the absolute values to get 


y=+ly| =the” = koe”, (9) 


“Technically, we are treating y = y(t) as a function of ¢ and both sides are integrated with respect 
to ft, but the left-hand side becomes an integral with respect to y using the change of variables 


y = y(t), dy = y'dt. 
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where k, = +k, is a nonzero real number. Now note that the equilibrium solution 
y = Ocan be absorbed into the family y = kyet by allowing ky = 0. Thus, the 
solution set can be written : 

y=ce, (10) 


where c is an arbitrary constant. < 


Example 5. Find the solutions of the differential equation 


yer, 
¥ 
(This example was considered in Example 2 of Sect. 1.2 via direction fields.) 


> Solution. We first rewrite the equation in the form ay 4 /y and separate the 


dt 
variables to get 
ydy = -t dt. 


Integration of both sides gives f ydy = — ft dt or sy? = —$0? +c. Multiplying 
by 2 and adding ¢? to both sides, we get 


y+P=c, 


where we write c instead of 2c since twice an arbitrary constant c is still an arbitrary 
constant. This is the standard equation for a circle of radius ./c centered at the 
origin, forc > 0. Solving for y gives 


y=4tve-??, 


the equations for the half circles we obtained in Example 2 of Sect. 1.2. < 


It may happen that a formula solution for the differential equation y’ = F(t, y) 
is possible, but the formula is sufficiently complicated that it does not shed much 
light on the nature of the solutions. In such a situation, it may happen that 
constructing a direction field and drawing the solution curves on the direction field 
gives useful insight concerning the solutions. The following example is such a 
situation. 


Example 6. Find the solutions of the differential equation 


_ ot=4 
oS 3y2— 40 


/ 


> Solution. Again we write y’ as 4 and separate the variables to get 


(3y? — 4) dy = (2t — 4) de. 
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Integration gives 
y—4y=t?-4t+e. 


Solving this cubic equation explicitly for y is possible, but it is complicated and 
not very revealing so we shall leave our solution in implicit form.> The direction 
field for this example was given in Fig. 1.7. As discussed in Example 6 of Sect. 1.2, 
the direction field reveals much more about the solutions than the explicit formula 
derived from the implicit formula given above. < 


Example 7. Solve the initial value problem 


y= . wsODST V3: 


Determine the maximum interval on which this solution is defined. 


> Solution. Since y? + 1 > 1, there are no equilibrium solutions. Separating the 
variables gives 


dy — dt 
y2 +1 ~~ 42? 
and integration of both sides gives tan~! y = —t +c. In this case, it is a simple 


matter to solve for y by applying the tangent function to both sides of the equation. 
Since tan(tan~! y) = y, we get 


y(t) = tan (-7 a c). 


To find c, observe that 1/./3 = y(1) = tan(—1 4+ c), which implies that ¢ — 1 = 
z/6,s0oc = 1+ 27/6. Hence, 


ox ees 

= tan { —- =). 
_ t 6 
To determine the maximum domain on which this solution is defined, note that the 
tangent function is defined on the interval (—2/2, 2/2), so that y(t) is defined for 
all t satisfying 


>The formula for solving a cubic equation is known as Cardano’s formula after Girolamo Cardano 
(1501-1576), who was the first to publish it. 


1.3. Separable Differential Equations 33 


Since —1 +14 - is increasing and the limit as t > oo is 1 + z < mi the second 
of the above inequalities is valid for all t > 0. The first inequality is solved to give 
t > 3/(3 + 27). Thus, the maximum domain for the solution y(f) is the interval 
(3/(3 + 277), 00). < 


Radioactive Decay 


In Example 2 of Sect. 1.1, we discussed the law of radioactive decay, which states: 
If N(t) is the quantity® of radioactive isotopes at time t, then the rate of decay is 
proportional to N(t). Since rate of change is expressed as the derivative with respect 
to the time variable f, it follows that N(t) is a solution to the differential equation 


N’'=-AN, 


where A is a constant. You will recognize this as a separable differential equation, 
which can be written in differential form with variables separated as 


dN 
— =-—)dt. 
N 


Integrating the left side with respect to N and the right side with respect to ¢ leads 
to In|N| = —At + ko, where ko is an arbitrary constant. As in Example 4, we can 
solve for N as a function of ¢ by applying the exponential function to both sides of 
In|N| = —At + ko. This gives 


|N| _— elnlN| _ ett tko = ek0e At = kie™, 


where k; = e* is a positive constant. Since N = +|N| = +k,e~", we conclude 
that N(t) = ce~*’, where c is an arbitrary constant. Notice that this family includes 
the equilibrium solution N = 0 when c = 0. Further, at time t = 0, we have 
N(0) = ce® = c. The constant c therefore represents the quantity of radioactive 
isotopes at time t = 0 and is denoted No. In summary, we find 


N(t) = Noe. (11) 


The constant A is referred to as the decay constant. However, most scientists prefer 
to specify the rate of decay by another constant known as the half-life of the 
radioactive isotope. The half-life is the time, Tt, it takes for half the quantity to decay. 


Thus, t is determined by the equation V(t) = +No or Noe~** = 4Np. Eliminating 


~ 2 


 N(t) could represent the number of atoms or the mass of radioactive material at time f. 
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No gives e~** = 5 which can be solved for t by applying the logarithm function 


In to both sides of the equation to get —At = In(1/2) = —In2 so 

In2 (12) 

T= —, 
Xr 

an inverse proportional relationship between the half-life and decay constant. Note, 
in particular, that the half-life does not depend on the initial amount No present. 
Thus, it takes the same length of time to decay from 2 g to | g as it does to decay 
from 1 g to 1/2g. 

Carbon 14, !4C, is a radioactive isotope of carbon that decays into the stable 
nonradioactive isotope nitrogen-14, '4N, and has a half-life of 5730 years. Plants 
absorb atmospheric carbon during photosynthesis, so the ratio of '4C to normal 
carbon in plants and animals when they die is approximately the same as that in 
the atmosphere. However, the amount of '*C decreases after death from radioactive 
decay. Careful measurements allow the date of death to be estimated.’ 


Example 8. A sample of wood from an archeological site is found to contain 75% 
of '*C (per unit mass) as a sample of wood found today. What is the age of the wood 
sample. 


> Solution. At ¢ = 0, the total amount, No, of carbon-14 in the wood sample 
begins to decay. Now the quantity is 0.75.No. This leads to the equation 0.75No = 
Noe". Solving for t gives t = — no? Since the half-life of '*C is 5730 years, 


(12) gives the decay constant A = a. Thus, the age of the sample is 


In 0.75 


t = 5730 — x 2378 


years. If the wood sample can be tied to the site, then an archeologist might be able 
to conclude that the site is about 2378 years old. < 
Newton’s Law of Heating and Cooling 


Recall that Newton’s law of heating and cooling (Example | of Sect. 1.1) states 
that the rate of change of the temperature, T(t), of a body is proportional to the 


7There are limitations, however. The ratio of '4C to other forms of carbon in the atmosphere is 
not constant as originally supposed. This variation is due, among other things, to changes in the 
intensity of the cosmic radiation that creates '4C. To compensate for this variation, dates obtained 
from radiocarbon laboratories are now corrected using standard calibration tables. 
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difference between that body and the temperature of ambient space. This law thus 
states that T(t) is a solution to the differential equation 


T’=r(T—-T), 


where 7, is the ambient temperature and r is the proportionality constant. This 
equation is separable and can be written in differential form as 


=rdt. 


T -—T, 


Integrating both sides leads to In|T — 7,| = rt + ko, where ko is an arbitrary 
constant. Solving for T — T; is very similar to the algebra we did in Example 4. We 
can solve for T — 7, as a function of t by applying the exponential function to both 
sides of In|7 — T,| = rt + ko. This gives 


|T = Ta| = eal Tal = elt tko _ eer = ke", 


where k,; = e“ is a positive constant. Since T — 7, = +|T — T,| = +k e", we 
conclude that T(t) — T, = ce", where c is an arbitrary constant. Notice that this 
family includes the equilibrium solution T = 7, when c = 0. In summary, we find 


T(t) =T, + ce". (13) 


Example 9. A turkey, which has an initial temperature of 40° (Fahrenheit), is 
placed into a 350° oven. After one hour, the temperature of the turkey is 100°. Use 
Newton’s law of heating and cooling to find 


1. The temperature of the turkey after 2h 
2. How many hours it takes for the temperature of the turkey to reach 170° 


> Solution. In this case, the oven is the surrounding medium and has a constant 
temperature of 7, = 350° so (13) gives 


T(t) = 350+ ce”. 


The initial temperature is 7(0) = 40°, and this implies 40 = 350 + c and hence 
c = —310. To determine r, note that we are given 7(1) = 100. This implies 100 = 
T(1) = 350 — 310e’, and solving for r gives r = In 2 x —0.21511. To answer 
question (1), compute T(2) = 350 — 310e?” = 148.39°. To answer question (2), 
we want to find ¢ so that T(t) = 170, that is, solve 170 = T(t) = 350 — 310e”. 
Solving this gives rt = In ‘ sot © 2.53h ¥ 2h 32 min. < 
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The Malthusian Growth Model 


Let P(t) represent the number of individuals in a population at time t. Two factors 
influence its growth: the birth rate and the death rate. Let b(t) and d(t) denote the 
birth and death rates, respectively. Then P’(t) = b(t) — d(t). In the Malthusian 
growth model, the birth and death rates are assumed to be proportional to the 
number in the population. Thus 


b(t) = BP(t) and d(t) = 6P(t), (14) 
for some real constants 6 and 6. We are thus led to the differential equation 
P(t) = (6-8) P@ =rP), (15) 


where r = 6 — 6. Except for the notation, this equation is the same as the equation 
that modeled radioactive decay. The same calculation gives 


POS Pet (16) 


for the solution of this differential equation, where Po = P(0) is the initial 
population. The constant r is referred to as the Malthusian parameter. 


Example 10. Suppose 50 bacteria are placed in a Petri dish. After 30 min there are 
120 bacteria. Assume the Malthusian growth model. How many bacteria will there 
be after 2h? After 6h? 


> Solution. The initial population is Pp = 50. After 30min we have 120 = 
P(30) = Poe"|,-39 = 50e%°”. This implies that the Malthusian parameter is 
r= + In 2. In 120 min, we have 


P(120) = Pye” 


1=120 
= 50e0 Sw 1,659. 
In 6h or 360 min, we have 
P(360) = Poe” ae, 
360 jy 12 
= 50e% "5 & 1,826,017. < 


While the Malthusian model may be a reasonable model for short periods of 
time, it does not take into account growth factors such as disease, overcrowding, 
and competition for food that come into play for large populations and are not seen 
in small populations. Thus, while the first calculation in the example above may be 
plausible, it is likely implausible for the second calculation. 
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The Logistic Growth Model 


Here we generalize the assumptions made in the Malthusian model about the birth 
and death rates.* In a confined environment, resources are limited. Hence, it is 
reasonable to assume that as a population grows, the birth and death rates will 
decrease and increase, respectively. From (14), the per capita birth rate in the 
Malthusian model, b(t)/ P(t) = B, is constant. Now assume it decreases linearly 
with the population, that is, b(t)/P(t) = B — kg P(t), for some positive constant 
kg. Similarly, assume the per capita death rate increases linearly with the population, 
that is, d(t)/P(t) = 6 + ks P(t), for some positive constant ks. We are then led to 
the following birth and death rate models: 


b(t) =(B—kgP(t))P(t) and d(t) = (8+ ks P(t) P(t). (17) 


Since the rate of change of population is the difference between the birth rate and 
death rate, we conclude 


P'(t) = b(t) —d(t) 
= ((B — 45) — (kp + ks) P(t)) P(t) 


k 
= (6-8 (1- ae Pw) P(t) 
= (1- =) P(t), (18) 
m 


where we setr = B —6 andm = (B —4)/(kg + ks) . Equation (18) shows that 
under the assumption (17), the population is a solution of the differential equation 


P 
P’ =r(1--) P, (19) 
m 


which is known as the logistic differential equation or the Verhulst population 
differential equation in its classical form. The parameter r is called the Malthusian 
parameter, it represents the rate at which the population would grow if it were 
unencumbered by environmental constraints. The number m is called the carrying 
capacity of the population, which, as explained below, represents the maximum 
population possible under the given model. 


8A special case was discussed in Exercise 2 of Sect. 1.1. 
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To solve the logistic differential equation (19), first note that the equation is 
separable since the right-hand side of the equation depends only on the dependent 
variable P. Next observe there are two equilibrium solutions obtained by constant 


solutions of the equation 
P 
r (: - | P=0. 
m 


These equilibrium (constant) solutions are P(t) = 0 and P(t) = m. Now proceed 
to the separation of variables algorithm. Separating the variables in (19) gives 


1 


—,.— dP = rd. 
(-5)P 
In order to integrate the left-hand side of this equation, it is first necessary to use 


partial fractions to get 


1 _ om al iz 1 
(1-2)P  (m-P)P m-P— P’ 


Thus, the separated variables form of (19) suitable for integration is 


1 1 
—)dP=rdt. 
(+5) 7 


Integrating the left side with respect to P and the right side with respect to ¢ gives 


—In|m— P| +In|P| =In|P/(m— P)| =rt +k, 


where & is the constant of integration. Using the same algebraic techniques 
employed in Example 4 and the earlier examples on radioactive decay and Newton’s 
law of cooling, we get 


P 
m—P 


= ce", 


for some real constant c. To solve for P, note that 
P =ce"(m— P)=cme™ — Pce™ = > P(1+ce") =cme"™. 
This gives 


cme" 
1+ce” 


P(t) = 


cm 
Se 20 
ewt + c ( ) 
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where the second equation is obtained from the first by multiplying the numerator 
and denominator by e~”’. 

The equilibrium solution P(t) = 0 is obtained by setting c = 0. The equilibrium 
solution P(t) = m does not occur for any choice of c, so this solution is an extra 
one. Also note that since r = 6 — 6 > 0 assuming that the birth rate exceeds the 


death rate, we have lim;_+5,e"’ = 0 so 
. ; cm cm 
lim P(t) = lim = =m, 
t—>0o toooe Th t¢ Cc 


independent of c ~ 0. What this means is that if we start with a positive population, 
then over time, the population will approach a maximum (sustainable) population m. 
This is the interpretation of the carrying capacity of the environment. 


When t = 0, we get P(0) = 7% and solving for c gives c = aTOr 
Substituting c into (20) and simplifying give 
P(O 
P(t) = = (21) 


P(0) + (m— P(0))e""" 


Equation (21) is called the logistic equation. That is, the logistic equation refers to 
the solution of the logistic differential equation. Below is its graph. You will note 
that the horizontal line P = m is an asymptote. You can see from the graph that 
P(t) approaches the limiting population m as ft grows. 


mP(0) 
P(0) + (m— P(0))e™ 
Example 11. Suppose biologists stock a lake with 200 fish and estimate the 
carrying capacity of the lake to be 10,000 fish. After two years, there are 2,500 
fish. Assume the logistic growth model and estimate how long it will take for there 
to be 9,000 fish. 


The graph of the logistic equation: P(t) = 
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> Solution. The initial population is P(0)=200 and the carrying capacity is 
m = 10,000. Thus, the logistic equation, (21), is 


P(t) = mP (0) _ 2,000,000 —_——:10,000 
~ P(0)+(m— P(0))e"* ~~ 200 +. 9,800e"""— 1: + 49e777 
Now let ¢ = 2 (assume that time is measured in years). Then we get 2,500 = 


10,000/(1 + 49e~?"), and solving for r gives r = $In 2. Now we want to know 


for what ¢t is P(t) = 9,000. With r as above the equation P(t) = 9,000 can be 
solved for ¢ to give 


21n 441 436 
= 7 © 4.36 years. 
In z 


The logistics growth model predicts that the population of fish will reach 9,000 in 
4.36 years. < 
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Exercises 


1-9. In each of the following problems, determine whether or not the equation is 
separable. Do not solve the equations! 


© 


10- 


CSO oe Ne 


ty’ = y—2ty 


r+ y? 


30. Find the general solution of each of the following differential equations. 


If an initial condition is given, find the particular solution that satisfies this initial 
condition. 


10. 
11. 
12. 
13. 
14. 
15. 
16. 
17, 
13: 
19. 
20. 
oi, 
2. 
93, 
24, ® 
25. 
26. 
a7. 
28. 


29. 


30. 
31. 


yy’ =t, yQ2)=-l 

(1— y*) —tyy’ =0 

yey’ =t 

yiy'=t+2 

y’ as ty? 

y’ + (tant)y = tant, -5 <t<F 
y’ = ty", where m and n are positive integers, n # 1. 
ya4yp— 9 

CS dee ae 

y= +1 

tyy’+2#7+1=0 
yt1l+oy-Dd+??)y’ =0 


wen dy _ u, y(0) =2 
ty—(t+2)y’ =0 
Solve the initial value problem 


42 


ae 
32 


33 


34 
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Determine the maximum interval (a, b) on which this solution is defined. Show 
that lim;_.,- y(t) = o. 


—34. Radioactive Decay 


. A human bone is found in a melting glacier. The carbon-14 content of the bone 
is only one-third of the carbon-14 content in a similar bone today. Estimate the 
age of the bone? The half-life of C-14 is 5,730 years. 

. Potassium-40 is a radioactive isotope that decays into a single argon-40 atom 
and other particles with a half-life of 1.25 billion years. A rock sample was 
found that contained 8 times as many potassium-40 atoms as argon-40 atoms. 
Assume the argon-40 only comes from radioactive decay. Date the rock to the 
time it contained only potassium-40. 

. Cobalt 60 is a radioactive isotope used in medical radiotherapy. It has a half-life 
of 5.27 years. How long will it take for a sample of cobalt 60 to reduce to 30% 
of the original? 


35-40. In the following problems, assume Newton’s law of heating and cooling. 


35 


38 


40 


. A bottle of your favorite beverage is at room temperature, 70°F, and it is then 
placed in a tub of ice water at time t = 0. After 30 min, the temperature is 55°. 
Assuming Newton’s law of heating and cooling, when will the temperature drop 
to 45°. 

. Acup of coffee, brewed at 180° (Fahrenheit), is brought into a car with inside 
temperature 70°. After 3 min, the coffee cools to 140°. What is the temperature 
2 min later? 

. The temperature outside a house is 90°, and inside it is kept at 65°. A thermo- 
meter is brought from the outside reading 90°, and after 2 min, it reads 85°. How 
long will it take to read 75°? What will the thermometer read after 20 min? 

. A cold can of soda is taken out of a refrigerator with a temperature of 40° 
and left to stand on the counter top where the temperature is 70°. After 2 h the 
temperature of the can is 60°. What was the temperature of the can | h after it 
was removed from the refrigerator? 

. A large cup of hot coffee is bought from a local drive through restaurant and 
placed in a cup holder in a vehicle. The inside temperature of the vehicle is 
70° Fahrenheit. After 5 min the driver spills the coffee on himself and receives 
a severe burn. Doctors determine that to receive a burn of this severity, the 
temperature of the coffee must have been about 150°. If the temperature of 
the coffee was 142° six minutes after it was sold what was the temperature at 
which the restaurant served it. 

. A student wishes to have some friends over to watch a football game. She wants 
to have cold beer ready to drink when her friends arrive at 4 p.m. According to 
her taste, the beer can be served when its temperature is 50°. Her experience 
shows that when she places 80° beer in the refrigerator that is kept at a constant 
temperature of 40°, it cools to 60° in an hour. By what time should she put the 
beer in the refrigerator to ensure that it will be ready for her friends? 


1.3. Separable Differential Equations 43 


41-43. In the following problems, assume the Malthusian growth model. 


41. The population of elk in a region of a national forest was 290 in 1980 and 370 
in 1990. Forest rangers want to estimate the population of elk in 2010. They 
assume the Malthusian growth model. What is their estimate? 

42. The time it takes for a culture of 40 bacteria to double its population is 3 h. How 
many bacteria are there at 30h? 

43. Ifit takes 5 years for a certain population to triple in size, how long does it take 
to double in size? 


44-47. In the following problems, assume the logistic growth model. 


44. The population of elk in a region of a national forest was 290 in 1980 and 370 
in 1990. Experienced forest rangers estimate that the carrying capacity of the 
population of elk for the size and location of the region under consideration 
is 800. They want to estimate the population of elk in 2010. They assume the 
logistic growth model. What is their estimate? 

45. A biologist is concerned about the rat population in a closed community in a 
large city. Initial readings 2 years ago gave a population of 2,000 rats, but now 
there are 3,000. The experienced biologist estimates that the community cannot 
support more than 5,000. The alarmed mayor tells the biologist not to reveal 
that to the general public. He wants to know how large the population will be at 
election time two years from now. What can the biologist tell him? 

46. Assuming the logistics equation P(t) = suppose P(0) = Po, 
P(to) = Pi, and P(2to) = P2. Show 


mPo 
Po+(m—Po)e—" ? 


nee P; (Pi (Po + P2) — 2PoP2) 


P?— PoP ’ 
1 (FF?) 
r=-—In : 
to Po(P2 — Pi) 


47. Four hundred butterflies are introduced into a closed community of the rain- 
forest and subsequently studied. After 3 years, the population increases to 700, 
and 3 years thereafter, the population increases to 1,000. What is the carrying 
capacity? 


44 


1 
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1.4 Linear First Order Equations 
A first order differential equation that can be written in the form 


y+ p(t)y = fit) (1) 


is called a linear first order differential equation or just linear, for short. We 
will say that (1) is the standard form for a linear differential equation.” We 
will assume that the coefficient function, p, and the forcing function, ff, are 
continuous functions on an interval 7. In later chapters, the continuity restrictions 
will be removed. Equation (1) is homogeneous if the forcing function is zero on 
I and nonhomogeneous if the forcing function f is not zero. Equation (1) is 
constant coefficient provided the coefficient function p is a constant function, that 
is, p(t) = po € Rforallt € J. 


Example 1. Characterize the following list of first order differential equations: 


l. y’=y-t 2.y+ty=0 
3. y’ = sect 4.y+y=t 
5.ty’ty=0? 6. y—-zy=44 
7. y' =Ty 8. y’ = tan(ty) 


> Solution. The presence of the term y? in (4) and the presence of the term tan(ty) 
in (8) prevent them from being linear. Equation (1), (5), and (7) can be written 
y’-—y =-t, y+ (1/t)y = t, and y’ — 7y = 0, respectively. Thus, all but (4) 
and (8) are linear. Equations (2) and (7) are homogeneous. Equations (1), (3), (5), 
and (6) are nonhomogeneous. Equations (1), (3), and (7) are constant coefficient. 
The interval of continuity for the forcing and coefficient functions is the real line for 
(1), (2), (7); an interval of the form (—> + mz, 5 + mz), m an integer, for (3); and 
(—oo, 0) or (0, co) for (5) and (6). < 


Notice (2), (3), and (7) are also separable. Generally, this occurs when either the 
coefficient function, p(t), is zero or the forcing function, f(t), is zero. Thus, there 
is an overlap between the categories of separable and linear differential equations. 


°This conflicts with the use of the term standard form, given in Sect. 1.1, where we meant a first 
order differential equation written in the form y’ = F(t, y). Nevertheless, in the context of first 
order linear differential equations, we will use the term standard form to mean an equation written 
as in (1). 
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A Solution Method for Linear Equations 


Consider the following two linear differential equations: 


ty’ +2y =4, (2) 
t?y! + 2ty = 4t. (3) 


They both have the same standard form 


(4) 


so they both have the same solution set. Further, multiplying (4) by f and 2? gives (2) 
and (3), respectively. Now (2) is simpler than (3) in that it does not have a needless 
extra factor of t. However, (3) has an important redeeming property that (2) does 
not have, namely, the left-hand side is a perfect derivative, by which we mean that 
t?y’ + 2ty = (t’y)’. Just apply the product rule to check this. Thus, (3) can be 
rewritten in the form 


(t?y)’ = 41, (5) 


and it is precisely this form that leads to the solution: Integrating both sides with 
respect to f gives t7y = 21? + c and dividing by ¢” gives 


y =2+ct”, (6) 


where c is an arbitrary real number. Of course, we could have multiplied (4) by any 
function, but of all functions, it is only z(t) = ft? (up to a multiplicative scalar) that 
simplifies the left-hand side as in (5). 

The process just described generalizes to an arbitrary linear differential equation 
in standard form 


yt+py=f. (7) 


That is, we can find a function jz so that when the left side of (7) is multiplied by 
pL, the result is a perfect derivative (t1y)’ with respect to the ¢ variable. This will 
require that 


by’ + wpy = (uy) = py’ + py. (8) 


Such a function jz is called an integrating factor. To find jz, note that simplifying (8) 
by canceling py’ gives uzpy = jp’ y, and we can cancel y (assuming that y(t) 4 0) 
to get 

KL’ = pp, (9) 
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a separable differential equation for the unknown function jz. Separating variables 
gives .’/j4 = p and integrating both sides gives In|u| = P, where P = [ pdt 
is any antiderivative of p. Taking the exponential of both sides of this equation 
produces a formula for the integrating factor 


wae? =el PM, (10) 


namely, jz is the exponential of any antiderivative of the coefficient function. For 
example, the integrating factor j1(t) = t? found in the example above is derived as 
follows: the coefficient function in (4) is p(t) = 2/t. An antiderivative is P(t) = 
2Int = In?? and hence p(t) = ec? = e™ = 7”, 

Once an integrating factor is found, we can solve (7) in the same manner as the 
example above. First multiplying (7) by the integrating factor gives wy’ + upy = 


Lf. By (8), wy’ + upy = (uy)’ so we get 
(uy) = uf. (11) 


Integrating both sides of this equation gives ny = f uf dt +c, and hence, 
1 c 
y= ; Lf dt+—, 
id i 


where c is an arbitrary constant. 

It is easy to check that the formula we have just derived is a solution. Further, we 
have just shown that any solution takes on this form. We summarize this discussion 
in the following theorem: 


Theorem 2. Let p and f be continuous functions on an interval I. A function y is 
a solution of the first order linear differential equation y' + py = f on I if and 
only if 


Solution of First Order Linear Equations 


1 Cc 
y=—fufdatt+—, 
ia ia 


where c € R, P is any antiderivative of p on the interval I, and up =e”. 


The steps needed to derive the solution when dealing with concrete examples are 
summarized in the following algorithm. 


Algorithm 3. The following procedure is used to solve a first order linear differen- 
tial equation. 
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Solution Method for First Order Linear Equations 


. Put the given linear equation in standard form: y' + py = f. 

. Find an integrating factor, : To do this, compute an antiderivative 
P = f pdt and set p= e?. 

3. Multiply the equation (in standard form) by js: This yields 


Ne 


by + py = pf. 
4. Simplify the left-hand side: Since (y)’ = jy’ + py, we get 
(uy) = uf. 
5. Integrate both sides of the resulting equation: This yields 


ny = f uf arte. 


6. Divide by yw to get the solution y: 


1 
yar fufas (12) 
i yl 


Remark 4. You should not memorize formula (12). What you should remember 
instead is the sequence of steps in Algorithm 3, and apply these steps to each 
concretely presented linear first order differential equation. 


Example 5. Find all solutions of the differential equation 
t?y’+ty=1 


on the interval (0, 00). 


> Solution. We shall follow Algorithm 3 closely. First, we put the given linear 
differential equation in standard form to get 


eyes (13) 
oe ge 


The coefficient function is p(t) = 1/t and its antiderivative is P(t) = In|t| = Int 
(since we are on the interval (0, 00), t = |t|). It follows that the integrating factor 
is w(t) =e!’ = fr. Multiplying (13) by y(t) = t gives 


j 1 
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Next observe that the left side of this equality is equal to < (ty). Thus, 


d 1 
an y= a 
Now take antiderivatives of both sides to get 
ty =Int+c, 
where c € R. Now dividing by the integrating factor x(t) = ¢t gives the solution 


Int Cc 
t)= —4+-. 
y(t) ; ; < 


Example 6. Find all solutions of the differential equation 
y’ = (tant)y + cost 


@ 3 uw 
on the interval J = (—4, 5). 
> Solution. We first write the given equation in standard form to get 

y’ —(tant)y = cost. 

The coefficient function is p(t) = —tan¢ (it is a common mistake to forget the 
minus sign). An antiderivative is P(t) = —Insect = Incost. It follows that w(t) = 
elncos!' — cost is an integrating factor. We now multiply by pz to get (cosf)y’ — 
(sint)y = cos? f, and hence, 


((cos t)y)’ = cos? ft. 


Integrating both sides, taking advantage of double angle formulas, gives 


1 
(cost)y = feosrar = / 5 (cos 2t + 1) dt 


1 1 
—t+ -—sin2t+c 
2 4 


II 


1 
a + sint cost) +c. 
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Dividing by the integrating factor j1(t) = cost gives the solution 


1 
y = (sect + sint) + ¢ sect. < 


Example 7. Find the solution of the differential equation 
w+y=t 


with initial condition y(0) = 2. 


> Solution. The given differential equation is in standard form. The coefficient 
function is the constant function p(t) = 1. Thus, z(t) = ef ldt — ef, Multiplying 
by e’ gives e’y’ + e’y = te’ which is 


(e'y)’ = te’. 
Integrating both sides gives e’y = fte'dt = te’ — e' + c, where f[ te’ dt is 
calculated using integration by parts. Dividing by e’ gives 


t 


y=t—l+ce’. 
Now the initial condition implies 2 = y(0) = 0— 1+ c and hence c = 3. Thus, 


y=t—-1+3e%. < 


Initial Value Problems 


In many practical problems, an initial value may be given. As in Example 7 above, 
the initial condition may be used to determine the arbitrary scalar in the general 
solution once the general solution has been found. It can be useful, however, to 
have a single formula that directly encodes the initial value in the solution. This is 
accomplished by the following corollary to Theorem 2, which also establishes the 
uniqueness of the solution. 


Corollary 8. Let p and f be continuous on an interval I, t) € I, and yo € R. 
Then the unique solution of the initial value problem 


y+py=f. y(t) =yo (14) 
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is given by 


t 
y(t) =e PO / e? F(u) du + ye ?, (15) 


to 


where P(t) = qe p(u) du. 


Proof. Let y be given by (15). Since P is an antiderivative of p, it follows that 


y = e? is an integrating factor. Replacing e? and e~” in the formula by jz and 


|, respectively, we see that y has the form given in Theorem 2. Hence, y(t) is a 
solution of the linear first order equation y’ + p(t)y = f(t). Moreover, P(to) = 
cy p(u) du = 0, and 


i) 
(to) = yoo PO + 2P J eP f(a) du = yo, 


to 


so that y(t) is a solution of the initial value problem given by (14). As to uniqueness, 
suppose that y;(t) is any other such solution. Set y2(t) = y(t) — y(t). Then 


¥2 + py2 = y'— y+ PO- ni) 
= y' + py—(y, + py) 
=f-f=0. 
Further, y2(to) = y(to) — yi(to) = 0. It follows from Theorem 2 that y2(t) = 
ce PO for some constant c € R and an antiderivative P(t) of p(t). Since y2(to) = 
0 ande~?“) ¥ 0, it follows that c = 0. Thus, y(t) — y\(t) = ya(t) = 0 for all 


t € I. This shows that y,(t) = y(t) for all t € J, and hence, y(t) is the only 
solution of (14). oO 


Example 9. Use Corollary 8 to find the solution of the differential equation 
ae es 


with initial condition y(0) = 2. 


> Solution. The coefficient function is p(t) = 1. Thus, P(t) = if p(u) du = 
ul, =t,e? = e! ande? =e. Let y be given as in the corollary. Then 


t 
y(t) =eP i oP f(u) du + yoo? 


it) 


t 
=e! / ue“ du + 2e° 
0 
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II 


e (ue“ —e")|) + 2e7 
e! (te’ — e' — (—1)) + 2e* 
=t—-l+e'+2e'=t—-1+3e. 


Rather than memorizing (15), it is generally easier to remember Algorithm 3 and 
solve such problems as we did in Example 7. < 


Example 10. Find the solution of the initial value problem 
/ + zee 1 
y Jy —_ 1 _—t ’ 
with y(0) = 0 on the interval (—oo, 1). 
> Solution. By Corollary 8, the solution is 


t Uu 
y(t) = ae | o du. 
0 l-u 


u 


Since the function = has no closed form antiderivative on the interval (—oo, 1), 
we might be tempted to stop at this point and say that we have solved the equation. 
While this is a legitimate statement, the present representation of the solution is 
of little practical use, and a further detailed study is necessary if you are “really” 
interested in the solution. Any further analysis (numerical calculations, qualitative 
analysis, etc.) would be based on what type of information you are attempting to 


ascertain about the solution. < 


Analysis of the General Solution Set 


For a linear differential equation y’ + py = f, where p and f are continuous 
functions on an interval J, Theorem 2 gives the general solution 


y =u f uf arte, 


where pp = e?, P = J pat, and c is an arbitrary constant. We see that the solution 
is the sum of two parts. 
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The Particular Solution 


When we set c = 0 in the general solution above, we get a single fixed solution 
which we denote by yp. Specifically, 


yaa | ufarae fe” fat. 


This solution is called a particular solution. Keep in mind though that there are 
many particular solutions depending on the antiderivative chosen for [ e? f dt. 
Once an antiderivative is fixed, then the particular solution is determined. 


The Homogeneous Solutions 


When we set f = Oin y+ py = ff, we get what is called the associated 
homogeneous equation, y’ + py = 0. Its solution is then obtained from the general 
solution. The integral reduces to 0 since f = 0 so all that is left is the second 
summand ce”. We set 


This solution is called the homogeneous solution. The notation is sometimes used 
a bit ambiguously. Mostly, we think of y, as a family of functions parameterized by 
c. Yet, there are times when we will have a specific c in mind and then yy will be an 
actual function. It will be clear from the context which is meant. 


The General Solution 


The relationship between the general solution yg of y’ + py = f, a particular 
solution yp of this equation, and the a homogeneous solution yy, is usually 
expressed as 

Ye = Vp + Vn. (16) 
What this means is that every solution to y’ + py = f can be obtained by starting 
with a single particular solution y, and adding to that the homogeneous solution yp. 
The key observation is the following. Suppose that y; and y2 are any two solutions 
of y’ + py = f. Then 


(v2 — yi)’ + P(Y2 — yi) = (99 + PY2) — CY + PY) 
=f-f 
— 0, 
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so that y2 — y; is a homogeneous solution. Let yy = y2 — yy. Then y2 = y; + yn. 
Therefore, given a solution y,(t) of y’ + p(t)y = f(t), any other solution y is 
obtained from y; by adding a homogeneous solution yp. 


Mixing Problems 


Example 11. Suppose a tank contains 10L of a brine solution (salt dissolved in 
water). Assume the initial concentration of salt is 100 g/L. Another brine solution 
flows into the tank at a rate of 3 L/min with a concentration of 400 g/L. Suppose the 
mixture is well stirred and flows out of the tank at a rate of 3 L/min. Let y(t) denote 
the amount of salt in the tank at time ¢. Find y(t). The following diagram may be 
helpful to visualize this problem. 


cl 
Salt Water 


> Solution. Here again is a situation in which it is best to express how a quantity 
like y(t) changes. If y(t) represents the amount (in grams) of salt in the tank, then 
y'(t) represents the total rate of change of salt in the tank with respect to time. It is 
given by the difference of two rates: the input rate of salt in the tank and the output 
rate of salt in the tank. Thus, 


y’ = input rate — output rate. (17) 


Both the input rate and output rate of salt are determined by product of the flow rate 
of the brine and the concentration of the brine solution. Specifically, 


amount of salt volume of brine amount of salt 


; : = ; : x —% (18) 
unit of time unit of time volume of brine 


In this example, the units of measure are liters(L), grams(g), and minutes(min). 


1.4 Linear First Order Equations 55 


Input Rate of Salt Since the inflow rate is 3 L/min and the concentration is fixed 
at 400 g/L we have 


ant 


L 
input rate = 3 —- x 400 2 = 1200 
min Ie min 


Output Rate of Salt The outflow rate is likewise 3 L/min. However, the concen- 
tration of the solution that leaves the tank varies with time. Since the amount of salt 
in the tank is y(t) g and the volume of fluid is always 10 L (the inflow and outflow 
rates are the same (3 L/min) so the volume never changes), the concentration of the 


fluid as it leaves the tank is x) g. We thus have 


L Lye _ 30 g 
min 10 L 10 min’ 


output rate = 3 


The initial amount of salt in the tank is y(0) = 100 r x 10 L = 1000 g. Equation 
(17) thus leads us to the following linear differential equation 


3y 


r= 1,900=—, 
y 10 


(19) 


with initial value y(0) = 1,000. 

In standard form, (19) becomes y’ + = y = 1,200. Multiplying by the integrating 
factor, e*/!9, leads to (e*/!°y)’ = 1,200e*/!°. Integrating and dividing by the 
integrating factor give 


y(t) = 4,000 + ce7 iv", 


Finally, the initial condition implies 1,000 = y(0) = 4,000 + c soc = —3,000. 
Hence, 


y(t) = 4,000 — 3,000e~70", (20) 


Below we give the graph of (20), representing the amount of salt in the tank at time f. 
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Grams of Salt 


—) 


>t 
10 15 
Time in minutes 


o 
Nn 


You will notice that lim;—.9(4,000 — 3,000e—2"/ 10) = 4,000 as indicated by the 
horizontal asymptote in the graph. In the long term, the concentration of the brine 


in the tank approaches am ng = 400 g/L. This is expected since the brine coming 
into the tank has concentration 400 g/L. < 


Problems like Example 11 are called mixing problems and there are many varia- 
tions. There is nothing special about the use of a salt solution. Any solvent with 
a solute will do. For example, one might want to study a pollutant flowing into a 
lake (the tank) with an outlet feeding a water supply for a town. In Example 11, 
the inflow and outflow rates were the same but we will consider examples where 
this is not the case. We will also consider situations where the concentration of 
salt in the inflow is not constant but varies as a function f of time. This function 
may even be discontinuous as will be the case in Chap. 6. In Chap.9, we consider 
the case where two or more tanks are interconnected. Rather than memorize some 
general formulas, it is best to derive the appropriate differential equation on a case 
by case basis. Equations (17) and (18) are the basic principles to model such mixing 
problems. 


Example 12. A large tank contains 100 gal of brine in which 50 lbs of salt are 
dissolved. Brine containing 2 lbs of salt per gallon flows into the tank at the rate 
of 6 gal/min. The mixture, which is kept uniform by stirring, flows out of the tank 
at the rate of 4 gal/min. Find the amount of salt in the tank at the end of ¢f minutes. 
After 50 min, how much salt will be in the tank and what will be the volume of 
brine? (The units here are abbreviated: gallon(s)=gal, pound(s) =Ibs, and minute(s) 
= min.) 


> Solution. Let y(t) denote the number of pounds of salt in the tank after ¢ 
minutes. Note that in this problem, the difference between inflow and outflow rates 
is 2 gal/min. At time f, there will be V(t) = 100 + 2t gal of brine, and so the 
concentration (in Ibs/gal) will then be 


y@) sy) 
V(t) 100+ 2t° 
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We use (18) to compute the input and output rates of salt: 
Input Rate 


. gal lbs lbs 
input rate = 6 x2 = 12 


min gal min 


Output Rate 


gal y(t) Ibs 4y(t) lbs 
output rate = 4 — x = —. 
min 100+ 2t gal 100+ 2¢ min 


Applying (17) yields the initial value problem 


4y(t) 


"t) =12- , 
¥™ 100 + 20 


y(0) = 50. 

Simplifying and putting in standard form give y’ + sary = 12. The coefficient 
function is p(t) = =. P(t) = f p(t)dt = 21n(50 + t) = In(50 + 1)’, and 
the integrating factor is z(t) = (50 + t)?. Thus, ((50 + t)*y)’ = 12(50 +4 1). 
Integrating and simplifying give 


Cc 
y@) = 460+) + Bos. 


The initial condition y(0) = 50 implies c = —3(50)? so 


3(50)3 


After 50 min, there will be y(50) = 400 — 2100 = 362.5 lbs of salt in the tank and 
200 gal of brine. < 
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Exercises 


1-25. Find the general solution of the given differential equation. If an initial 
condition is given, find the particular solution which satisfies this initial condition. 


1. y’'+3y=e', y(0)=-2 

2. (cost)y’ + (sinthy =1, y(0)=5 
3. y’-2y =e, y(0)=4 

4. ty’ +y=e' 

5. ty’ +y=e', y(lI)=0 

6. ty’ + my = t ln(t), where m is a constant 
7. y’ =—*% + cos(t?) 

8. y’+2y = sint 

9. y’—3y = 25cos4t 
10. ¢(t+)y’ =2+y 
ll, 2=2g=P) 


12. y’ + ay = b, where a and b are constants 
13. y’+ ycost=cost, y(0)=0 
2 
14. y’- ——y=(t+ 1) 
ya 
2 t+1 


—4 where a is a constant 


16. y’ +ay=e 

17. y’ + ay =e", where a and b are constants and b 4 —a 

18. y’ + ay = t"e™, where a is a constant 

19. y’ = ytant + sect 

20. ty’ + 2ylnt = 4Int 

21. y’- “y =e" 

22. y’-y=te*, y(O)=a 

23. ty’ +3y=t7?, y(-l1)=2 

24. y'+2ty=1, yO)=1 

25. t?y’+2ty=1, y2)=a 

26-33. Mixing Problems 

26. A tank contains 100 gal of brine made by dissolving 80 |b of salt in water. Pure 
water runs into the tank at the rate of 4 gal/min, and the mixture, which is kept 


uniform by stirring, runs out at the same rate. Find the amount of salt in the tank 
at any time ¢. Find the concentration of salt in the tank at any time f. 


60 


27. 


28. 


29. 


30. 


31. 


32. 
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A tank contains 10 gal of brine in which 21b of salt is dissolved. Brine 
containing | lb of salt per gallon flows into the tank at the rate of 3 gal/min, 
and the stirred mixture is drained off the tank at the rate of 4 gal/min. Find the 
amount y(t) of salt in the tank at any time ¢. 

A tank holds 10L of pure water. A brine solution is poured into the tank at a 
rate of 1 L/min and kept well stirred. The mixture leaves the tank at the same 
rate. If the brine solution has a concentration of 10g of salt per liter, what will 
the concentration be in the tank after 10 min. 

A 30-L container initially contains 10L of pure water. A brine solution 
containing 20g of salt per liter flows into the container at a rate of 4L/min. 
The well-stirred mixture is pumped out of the container at a rate of 2 L/min. 


(a) How long does it take for the container to overflow? 
(b) How much salt is in the tank at the moment the tank begins to overflow? 


A 100-gal tank initially contains 10 gal of fresh water. At time t = 0, a 
brine solution containing 0.5 Ib of salt per gallon is poured into the tank at the 
rate of 4 gal/min while the well-stirred mixture leaves the tank at the rate of 
2 gal/min. 


(a) Find the time 7 it takes for the tank to overflow. 
(b) Find the amount of salt in the tank at time 7’. 
(c) If y(t) denotes the amount of salt present at time f, what is lim;—.99 y(t)? 


For this problem, our tank will be a lake and the brine solution will be polluted 
water entering the lake. Thus, assume that we have a lake with volume V which 
is fed by a polluted river. Assume that the rate of water flowing into the lake 
and the rate of water flowing out of the lake are equal. Call this rate r, let c be 
the concentration of pollutant in the river as it flows into the lake, and assume 
perfect mixing of the pollutant in the lake (this is, of course, a very unrealistic 
assumption). 


(a) Write down and solve a differential equation for the amount P(t) of 
pollutant in the lake at time ¢ and determine the limiting concentration of 
pollutant in the lake as t > oo. 

(b) At time ¢ = 0, the river is cleaned up, so no more pollutant flows into the 

lake. Find expressions for how long it will take for the pollution in the lake 

to be reduced to (i) 1/2 and (1) 1/10 of the value it had at the time of the 
cleanup. 

Assuming that Lake Erie has a volume V of 460 km? and an inflow—outflow 

rate of r = 175km?/year, give numerical values for the times found in Part 

(b). Answer the same question for Lake Ontario, where it is assumed that 

V = 1640km? and r = 209km?/year. 


(c 


wm 


Two tanks, Tank 1 and Tank 2, are arranged so that the outflow of Tank 1 is 
the inflow of Tank 2. Each tank initially contains 10 L of pure water. A brine 
solution with concentration 100 g/L flows into Tank | at a rate of 4 L/min. The 
well-stirred mixture flows into Tank 2 at the same rate. In Tank 2, the mixture is 
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well stirred and flows out at a rate of 4 L/min. Find the amount of salt in Tank 2 
at any time t. The following diagram may be helpful to visualize this problem. 


Tank 1 


Tank 2 


33. Two large tanks, Tank | and Tank 2, are arranged so that the outflow of Tank 1 
is the inflow of Tank 2, as in the configuration of Exercise 32. Tank 1 initially 
contains 10 L of pure water while Tank 2 initially contains 5 L of pure water. A 
brine solution with concentration 10 g/L flows into Tank 1 at a rate of 4 L/min. 
The well-stirred mixture flows into Tank 2 at a rate of 2 L/min. In Tank 2, the 
mixture is well stirred and flows out at a rate of 1 liter per minute. Find the 
amount of salt in Tank 2 before either Tank | or Tank 2 overflows. 


62 


1 


First Order Differential Equations 


1.5 Substitutions 63 
1.5 Substitutions 


Just as a complicated integral may be simplified into a familiar integral form by 
a judicious substitution, so too may a differential equation. Generally speaking, 
substitutions take one of two forms. Either we replace y in y’ = F(t, y) by some 
function y = ¢(t, v) to get a differential equation v’ = G(t, v) in v and f, or we set 
z= W(t, y) for some expression w(t, y) that appears in the formula for F(t, y), 
resulting in a differential equation z = H(t, z) in z and t. Of course, the goal is 
that this new differential equation will fall into a category where there are known 
solution methods. Once the unknown function v (or z) is determined, then y can be 
determined by y = $(t,v) (or implicitly by z = w(t, y)). In this section, we will 
illustrate this procedure by discussing the homogeneous and Bernoulli equations, 
which are simplified to separable and linear equations, respectively, by appropriate 
substitutions. 


Homogeneous Differential Equations 


A homogeneous differential equation" is a first order differential equation that can 
be written in the form 


y=f(5). (1) 
for some function f. To solve such a differential equation, we use the substitution 
y = tv, where v = v(f) is some unknown function and rewrite (1) as a differential 
equation in terms of ¢ and v. By the product rule, we have y’ = v+ fv’. Substituting 
this into (1) gives v + tv’ = f(tv/t) = f(v), a separable differential equation for 
which the variables ¢ and v may be separated to give 


dv _ dt (2) 
fw—-v t- 


Once v is found we may determine y by the substitution y = tv. It is not useful to 
try to memorize (2). Rather, remember the substitution method that leads to it. As 
an illustration, consider the following example. 


Example 1. Solve the following differential equation: 


ees 
Se 
t—y 


‘OUnfortunately, the term “homogeneous” used here is the same term used in Sect. 1.4 to describe 
a linear differential equation in which the forcing function is zero. These meanings are different. 
Usually, context will determine the appropriate meaning. 
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> Solution. This differential equation is neither separable nor linear. However, it 
is homogeneous since we can write the right-hand side as 


t+y = (/t)t+ty a 1+ (y/t) 
t-y (/t-y 1-(G/t)’ 


which is a function of y/t. Let y = tv, so that y’ = v + tv’. The given differential 
equation can then be written as 


v+t'= : 
l-v 


Now subtract v from both sides and simplify to get 


7 l+v 14+v? 
= —Vv= 


l-v l-v- 


tv 


Separating the variables gives 


dv vdv dt 


ie TSO 


Integrating both sides gives us tan~! v— (1/2) In(1 + v?) = Int +c. Now substitute 
v = y/t to get the implicit solution 


1 
tan”! (y/t) — 5 In(1 + (y/t)?) = Int +c. 
This may be simplified slightly (multiply by 2 and combine the In terms) to get 
2tan!(y/t)—In(t?+y”) = 2c. < 


A differential equation y’ = F(t, y) is homogeneous if we can write F(t, y) = 
f(y/t), for some function f. This is what we did in the example above. To help 
identify situations where the identification F(t, y) = f(y/t) is possible, we 
introduce the concept of a homogeneous function. A function p(t, y) is said to be 
homogeneous of degree n if p(at,ay) = a” p(t, y), for all a > 0. To simplify the 
terminology, we will call a homogeneous function of degree zero just homogeneous. 
For example, the polynomials ¢? + ty? and y? are both homogeneous of degree 3. 
Their quotient F(t, y) = (t? + ty?)/y? is a homogeneous function. Indeed, if 
a > 0, then 


t)3 t 2 3 43 ty2 
Fatay) = GAD? _ OP +1 
y 


ORT eo = F(t, y). 
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In fact, it is easy to see that the quotient of any two homogeneous functions of the 


same degree is a homogeneous function. Suppose t > 0 and let a = 1/t. Fora 
homogeneous function F’, we have 


Fit, y)=F (4 +7) =F (i *). 


Similarly, if ¢ <0 anda = —1/t then 


F(t, y) =F (>. =y) =F (-1,-=) 


Therefore, if F(t, y) is homogeneous, then F(t, y) = f(t/y) where 


7 F (1.2) ift > 0, 


a F(-1,-2) ift <0 


so that we have the following useful criterion for identifying homogeneous func- 
tions: 


Lemma 2. /f F(t, y) is a homogeneous function, then it can be written in the form 


y. 
for some function f. Furthermore, the differential equation y'’ = F(t, y) is a 
homogeneous differential equation. 


Example 3. Solve the following differential equation 


fe t? + 2ty — y? 
202 , 


> Solution. Since the numerator and denominator are homogeneous of degree 
2, the quotient is homogeneous. Letting y = fv and dividing the numerator and 
denominator of the right-hand side by t”, we obtain 


1+2v—v? 


+t’ = 
Vv Vv 5) 


; : i -y Pre : 
Subtracting v from both sides gives tv’ = ! >_- There are two equilibrium solutions: 


v= +1. If v 4 +1, separate the variables to get 


2dv dt 
1-v ot 


’ 
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and apply partial fractions to the left-hand side to conclude 


dv dv dt 
+ =—. 
l-v l+v t 


Integrating gives —In|1 — v| + In|1 + v| = In|t| + c, exponentiating both sides 


gives he = kt fork # 0, and simplifying leads to v = po. k # 0. Substituting 
y = vt gives the solutions 
kt? —t 
= —, kF0, 
okt +1 7 
whereas the equilibrium solutions v = +1 produce the solutions y = +1. Note that 
for k = 0, we get the solution y = —t, which is one of the equilibrium solutions, 
but the equilibrium solution y = ¢ does not correspond to any choice of k. < 
Bernoulli Equations 


A differential equation of the form 


y+ py = fy", (3) 


is called a Bernoulli equation.'' If n = 0, this equation is linear, while ifn = 1, 
the equation is both separable and linear. Thus, we will assume n + 0, 1. Note, also, 
that ifn > 0, then y = 0 is a solution. Start by dividing (3) by y” to get 


y "y+ py!” = f@. (4) 


Use the coefficient of p(t) as a new dependent variable. That is, use the substitution 
z = y!”. Thus, z is treated as a function of ¢ and the chain rule gives 7 = (1 — 
n)y—"y’, which is the first term of (4) multiplied by 1 — n. Therefore, substituting 
for z and multiplying by the constant (1 — 7) give, 


Z+(l—n)p(t)z = 1 -an) fo), (5) 


which is a linear first order differential equation in the variables t and z. Equation 
(5) can then be solved by Algorithm 3 of Sect. 1.4, and the solution to (3) is obtained 
by solving z = y'~” for y (and including y = 0 in the case n > 0). 


Example 4. Solve the Bernoulli equation y’ + y = 5(sin2r)y?. 


'lNamed after Jakoub Bernoulli (1654-1705). 
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> Solution. Note first that y = 0 is a solution sincen = 2 > 0. After dividing our 


equation by y”, we get y *y’ + y-! = S5sin2t. Letz = y—!. Then z’ = —y~*y’ 


and substituting gives —z’ + z = 5sin2t. In the standard form for linear equations, 
this becomes 


Z—z=—Ssin2t. 

We can apply Algorithm 3 of Sect. 1.4 to this linear differential equation. The 
integrating factor will be e~’. Multiplying by the integrating factor gives (e~'z)’ = 
—5e~ sin 2t. Now integrate both sides to get 


e 7S [nse sin2t dt = (sin2t +2cos2r)e" +c, 


where { —5e~ sin 2t dt is computed by using integration by parts twice. Hence, 
z= sin2t + 2cos2t + ce’. 


Now go back to the original function y by solving z = y~! for y to get 


1 
sin 2t + 2cos2t + cel’ 


y=z! = (sin2t + 2cos2t + ce’)! = 


This function y, together with y = 0, constitutes the general solution of y’ + y = 
5(sin 2t)y?. < 


Remark 5. We should note that in the z variable, the solution z = sint —cost +ce! 
is valid for all ¢ in R. This is to be expected. Since z’ — z = —5 sin 2t is linear and 
the coefficient function, p(t) = 1, and the forcing function, f(t) = —5 sin 2f, are 
continuous on R, Theorem 2 of Sect. 1.2 implies that any solution will be defined 
on all of R. However, in the y variable, things are very different. The solution y = 
1/(sin t—cost+ce’) to the given Bernoulli equation is valid only on intervals where 
the denominator is nonzero. This is precisely because of the inverse relationship 
between y and z: the location of the zeros of z is precisely where y has a vertical 
asymptote. In the figure below, we have graphed a solution in the z variable and 
the corresponding solution in the y = 1/z variable. Note that in the y variable, the 
intervals of definition are determined by the zeros of z. Again, it is not at all evident 
from the differential equation, y’— y = —2(sint)y”, that the solution curves would 
have “chopped up” intervals of definition. The linear case as described in Theorem 
2 of Sect. 1.4 is thus rather special. 
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a-e-H-H- HH 


l/s s4eee 


od 


t 
Solution Curve in z for 


Solution Curve in Y for 


2 


S(sin 2t)y 


y! + y= 


z!—z= —5 sin 2t 


Linear Substitutions 


Consider a differential equation of the form 


(6) 


y' = flat + by +0), 


a + by’ so 


at + by +c. Then? = 


where a, b, c are real constants. Let z = 


y! 


(z' — a)/b. Substituting gives (z’ — a)/b = f(z) which in standard form is 


Z =bf(2) +a, 


a separable differential equation. Consider the following example. 


Example 6. Solve the following differential equation: 


y=(t+ty+)?. 


=1+y'soy’ = z —1. Substituting 


> Solution. Let z = ¢ + y + 1. Then 2’ 


gives 7’ — 1 = 2’, and in standard form, we get the separable differential equation 


z = 1+ 2’. Separating variables gives 


5 = dt. 


dz 
1+z 
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Integrating gives tan”! z = t +c. Thus, z = tan(t +c). Now substitute z= ¢+y+1 
and simplify to get the solution 


y =-—t—1+tan(t+c). < 


Substitution methods are a general way to simplify complicated differential 
equations into familiar forms. These few that we have discussed are just some of 
many examples that can be solved by the technique of substitution. If you ever come 
across a differential equation you cannot solve, try to simplify it into a familiar form 
by finding the right substitution. 
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Exercises 


1-8. Find the general solution of each of the following homogeneous equations. If 
an initial value is given, also solve the initial value problem. 


1. yl =y?+yt+2?, yOX=1 


> ja) 
: =n 
2 2 
y~ —4yt + 6t 
3. o> — 7 y(2) =4 
4 Prey aa 
12+ yt 
P ,_3r—P 
ae 2ty 
2 2 
6. y= aw y(e) = 2e 
ly 


7. ty =yt+ JVt?—-y? 

8. ty’ =yt+yVt?+ y? 
9-17. Find the general solution of each of the following Bernoulli equations. If an 
initial value is given, also solve the initial value problem. 


9. y-y=ty’, yO)=1 

10. +y=y’, y0)=1 

11. y'+ty =ty? 

12. y +ty = fy? 

13. (1—?t?)y’ —ty = Sty? 

14, y+ = = 2/3 

15. yy’ +ty?=t, y(0)=-2 

16. 2yy’=y?+t-1 

17, y +y=ty? 

18. Write the logistic differential equation P’ = r(1 — ?)pP ((19) of Sect. 1.3) as 
a Bernoulli equation and solve it using the technique described in this section. 


19-22. Use an appropriate linear substitution to solve the following differential 
equations: 


19. y' =(2t-2y + 17 
20. y =(t—y)? 


Ce oe 
(YG 


22. y’ = sin(t — y) 
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23-26. Use the indicated substitution to solve the given differential equation. 


23. 2yy’ = y?+t-—1,2= y? +t —1 (Compare with Exercise 16.) 
2cost 


24. y’ =tany + ,2=siny 
cos y 
25. y +ylny=ty,z=Iny 


26. y =-e’ —l,z=e” 
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1.6 Exact Equations 


When y(t) is any function defined implicitly by an equation 
Vit, y) =, 


that is, 
V(t, yt) =c 


for all ¢ in an interval J, implicit differentiation of this equation with respect to t 
shows that y(t) satisfies the equation 


dd av av 
0O= a = gp OD = yy yO) =F By Oy (t), 


and thus is a solution of the differential equation 


For example, any solution y(t) of the equation y? + 2yt — y? = c isa solution of 
the differential equation 


(2y —2t) + (2y + 2t)y’ =0. 
Conversely, suppose we are given a differential equation 
M+Ny'=0, () 


where M and WN are functions of the two variables ¢ and y. If there is a function 
V(t, y) for which 


_ a 


and N = —, 
dy 


II 
| 


(2) 


then we can work backward from the implicit differentiation in the previous 
paragraph to conclude that any implicitly defined solution of 


Vit, y=, (3) 


for c an arbitrary constant, is a solution of the differential equation (1). To summa- 
rize, if the given functions M and N in (1) are such that there is a function V(t, y) 
for which equations (2) are satisfied, then the solution of the differential equation 
(1) is given by the implicitly defined solutions to (3). In this case, we will say that 
the differential equation M + Ny’ = 0 is an exact differential equation. 
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Suppose we are given a differential equation M + Ny’ = 0, but we are not given 
a priori that M = 0V/dt and N = 0V/dt. How can we determine if there is such a 
function V(t, y), and if there is, how can we find it? That is, is there a criterion for 
determining if a given differential equation is exact, and if so, is there a procedure 
for producing the function V(t, y) that determines the solution via V(t, y) = c. 
The answer to both questions is yes. 

A criterion for exactness comes from the equality of mixed partial derivatives. 
Recall (from your calculus course) that all functions V(t, y) whose second partial 
derivatives exist and are continuous satisfy!” 


0 (aV 0 (oV 
= (4) 
dy \ of ot \ dy 
If the equation M + Ny’ = Ois exact, then, by definition, there is a function V(t, y) 
such that OV/dt = M and 0V/dy = N, so (4) gives 


0M 0 (dV\ _ 9a (dV\ _ ON 
dy dy\at) at \ay) ar’ 


Hence, a necessary condition for exactness of M + Ny’ = Ois 


OM ON 
= or (5) 
y ot 
We now ask if this condition is also sufficient for the differential equation M + 
Ny’ = Oto be exact. That is, if (5) is true, can we always find a function V(t, y) 
such that M = 0V/ot and N = 0V/dy? We can easily find V(t, y) such that 


oV 
an M (6) 


by integrating M with respect to the ¢ variable. After determining V(t, y) so that 
(6) holds, can we also guarantee that OV/dy = N? Integrating (6) with respect to ¢, 
treating the y variable as a constant, gives 


V= [ar + 600. (7) 


The function ¢(y) is an arbitrary function of y that appears as the “integration 
constant” since any function of y goes to 0 when differentiated with respect to f. 
The “integration constant” @(y) can be determined by differentiating V in (7) with 
respect to y and equating this expression to N since dV/dy = N if the differential 


This equation is known as Clairaut’s theorem (after Alexis Clairaut (1713-1765)) on the equality 
of mixed partial derivatives. 
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equation is exact. Thus (since integration with respect to ¢ and differentiation with 
respect to y commute) 


F) d¢ aM d¢ 
a i ay ‘c iY ay me 


That is, 


=N- [> —— dt. (9) 


The verification that the function vr the right is really a function only of y (as it 
must be if it is to be the derivative $¢ © of a function of y) is where condition (5) is 
needed. Indeed, using (5) 


v- [> aes v- [> & at =N-(N 440) =-¥6). (10) 


Hence, (9) is a valid equation for determining ¢@(y) in (7). 
We can summarize our conclusions in the following result. 


Theorem 1 (Criterion for exactness). A first order differential equation 


M(t, y)+ Nit, yy’ =0 


is exact if and only if 


aM _ aN 


ae OE (11) 


If this condition is satisfied, then the general solution of the differential equation is 
given by V(t, y) =c, where V(t, y) is determined by (7) and (9). 


The steps needed to derive the solution of an exact equation when dealing with 
concrete examples are summarized in the following algorithm. 


Algorithm 2. The following procedure is used to solve an exact differential 
equation. 
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Solution Method for Exact Equations 
1. Check the equation M + Ny’ = 0 for exactness: To do this, check if 


aM _ aN 
dy at 


2. Integrate the equation M = 0V/dt with respect to t to get 


vt, y) = i MG. Sar 4-06), (12) 


where the “integration constant” (y) is a function of y. 


3. Differentiate this expression for V(t, y) with respect to y, and set it equal 


ne a dp av 
y (/ me. yar) a a ie N(t, y). 


4. Solve this equation for so: 


d a 
nM =NO— 5 (/ M(t, yar), (13) 


5. Integrate < to get p(y) and then substitute in (12) to find V(t, y). 


6. The solution of M + Ny' = 0 is then given by 
Vit, y)=C, (14) 


where c is an arbitrary constant. 


It is worthwhile to emphasize that the solution to the exact equation M + Ny’ =0 
is not the function V(t, y) found by the above procedure but rather the functions 
y(t) defined by the implicit relation V(t, y) = c. 


Example 3. Determine if the differential equation 
(307 + 4ty — 2) + (21? + 6y)y’ =0 
is exact. If it is exact, solve it. 


> Solution. This equation is in the standard form M + Ny’ with M(t, y) = 317+ 
4ty —2 and M(t, y) = 22? + 6y?. Then 


0M aN 
heap | a eee 
oy ot 
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so the exactness criterion is satisfied and the equation is exact. To solve the equation, 
follow the solution procedure by computing 


Vit, y) = [oe + 4ty —2)dt+(y) =t 4 2t’y —2t + o(y), 


where #(y) is a function only of y that is yet to be computed. Now differentiate this 
expression with respect to y to get 


But since the differential equation is exact, we also have 


OV 


— = N(t, y) = 20? + 6y’, 
dy 


and combining these last two expressions, we conclude 


dp _ 
dy 


6y?. 


Integrating with respect to y gives $(y) = 2y? + co, so that 
VG PHO Or y= 2 yr Sy, 


where Co is a constant. The solutions of the differential equation are then given by 
the relation V(t, y) = c, that is, 


42ry—2t+2y%?=c, 


where the constant co has been incorporated in the constant c. < 


What happens if we try to solve the equation M(t, y) + N(t, y)y’ = 0 by the 
procedure outlined above without first verifying that it is exact? If the equation is 
not exact, you will discover this fact when you get to (9), since ve will not be a 
function only of y, as the following example illustrates. 


Example 4. Try to solve the equation (t — 3y) + (2t + y)y’ = 0 by the solution 
procedure for exact equations. 


> Solution. Note that M(t, y) = ¢ —3y and N(t, y) = 2t + y. First apply (12) 
to get 


2 


Vit, y) = [me y),dt = fo —3y)dr = 5 —3ty + 60, 
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and then determine ¢(y) from (13): 


do f) ose 
5. = NG y)— a | MG, y)dt = Qt+y)—a | > —-3ty +60) ] = yt. 
dy oy dy \2 
But we see that there is a problem since @ = y —t involves both y and ¢. This is 


where it becomes obvious that you are not dealing with an exact equation, and you 
cannot proceed with this procedure. Indeed, JM/dy = —3 4 2 = ON/dt, so that 
this equation fails the exactness criterion (11). | 


Integrating Factors 


The differential equation 
3y? + 8 + 2tyy’ =0 (15) 


can be written in the form M + Ny’ = 0 where 
M=3y?+8t and WN =2ty. 


Since 


the equation is not exact. However, if we multiply (15) by t*, we arrive at an 
equivalent differential equation 


3y*t? + 823 + 2 yy’ = 0, (16) 


that is exact. Indeed, in the new equation, M = 3y7t? + 877 and N = 2r?y so that 
the exactness criterion is satisfied: 


Using the solution method for exact equations, we find 


Vit, y) = / (3y72? + 827) dt = y?#? + 274 + 6(y), 


where 
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Thus, “ = 0 so that 
Vit, y) = y7t? + 2t* + ©. 


Therefore, incorporating the constant co into the general constant c, we have 
yt? + 2t* =c, 


as the solution of (16) and, hence, also of the equivalent equation (15). Thus, 
multiplication of the nonexact equation (15) by the function t? has produced an 
exact equation (16) that is easily solved. 

This suggests the following question. Can we find a function j(t, y) so that 
multiplication of a nonexact equation 


M+Ny'=0 (17) 


by jz produces an equation 
uM + uNy' =0 (18) 


that is exact? When there is such a j2, we call it an integrating factor for (17). 
The exactness criterion for (18) is 


d(uM) _ (uN) 
dy ot 


Written out, this becomes 


M—= N—, 
e oy = oy Pot = at 
which implies 
OM eu = (> a) (19) 
a Coy. Oy 


Thus, it appears that the search for an integrating factor for the nonexact ordinary 
differential equation (17) involves the solution of (19), which is a partial differential 
equation for ju. In general, it is quite difficult to solve (19). However, there are some 
special situations in which it is possible to use (19) to find an integrating factor ju. 
One such example occurs if jz is a function only of t. In this case, du/dt = djz/dt 
and du/dy = 0 so (19) can be written as 


ld aM -—0 
he /oy N/ot (20) 
lL dt N 


Since the left-hand side of this equation depends only on ¢, the same must be true 
of the right-hand side. We conclude that we can find an integrating factor 1 = p(t) 
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consisting of a function only of ¢ provided the right-hand side of (20) is a function 
only of ¢. If this is true, then we put 


aM /dy — ON/dt _ 


7 P(t), (21) 


so that (20) becomes the linear differential equation uw’ = p(t), which has the 
solution 


w(t) = ef POH, (22) 


After multiplication of (17) by this z(t), the resulting equation is exact, and the 
solution is obtained by the solution method for exact equations. 


Example 5. Find an integrating factor for the equation 
3y? + 8t + 2tyy’ = 0. 


> Solution. This equation is (15). Since 


dM/dy—dN/dt _6y—2y 2 
N Oy ge 


is a function of only t, we conclude that an integrating factor is 
u(t) = ef (2/t) dt = e2int _ 12. 


This agrees with what we already observed in (16). < 


Similar reasoning gives a criterion for (17) to have an integrating factor jz(y) that 
involves only the variable y. Namely, if the expression 


dM /ay — aN/at 


—= (23) 


is a function of only y, say g(y), then 
p(y) = ef 200% (24) 


is a function only of y that is an integrating factor for (17). 


Remark 6. A linear differential equation y’ + p(t)y = f(t) can be rewritten in 
the form M + Ny’ = 0 where M = p(t)y — f(t) and N = 1. In this case, 
dM /dy = p(t) and dN/dt = 0 so a linear equation is never exact unless p(t) = 0. 
However, 


OM/dy — ON/at _ 
N 


P(t) 
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so there is an integrating factor that depends only on tr: 
L(t) = el! p(t) dt 


This is exactly the same function that we called an integrating factor for the linear 
differential equation in Sect. 1.4. Thus, the integrating factor for a linear differential 
equation is a special case of the concept of an integrating factor to transform a 
general equation into an exact one. 
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1.6 Exact Equations 83 
Exercises 


1-9. Determine if the equation is exact, and if it is exact, find the general solution. 


1. (y? + 2t) + 2tyy’ =0 

2. y-t+(t4+2y)y’=0 

3. 227-y+(t+y)y =0 

4. y? + 2tyy’ + 3t? =0 

5. 3y —5t)+2yy’—ty’ =0 

6. 2ty + (t? + 3y7)y’ =0, yA) = 1 

7. 2ty+20+(t?-y)y’ =0 

8. tr? —y—ty’=0 

9. (ye —t)y’ = y 
10. Find conditions on the constants a, b, c, d which guarantee that the differential 


equation (at + by) = (ct + dy)y’ is exact. 
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1.7. Existence and Uniqueness Theorems 


Let us return to the general initial value problem 


y' =F(t, y), y(to) = yo, (1) 


introduced in Sect. 1.1. We want to address the existence and uniqueness of solutions 
to (1). The main theorems we have in mind put certain relatively mild conditions on 
F to insure that a solution exists, is unique, and/or both. We say that a solution exists 
if there is a function y = y(t) defined on an interval containing fo as an interior 
point and satisfying (1). We say that a solution is unique if there is only one such 
function y = y(t). Why are the concepts of existence and uniqueness important? 
Differential equations frequently model real-world systems as a function of time. 
Knowing that a solution exists means that the system has predictable future states. 
Further, when that solution is also unique, then for each future time there is only 
one possible state, leaving no room for ambiguity. 

To illustrate these points and some of the theoretical aspects of the existence and 
uniqueness theorems that follow, consider the following example. 


Example 1. Show that the following two functions satisfy the initial value problem 


yea) 2O)So. (2) 


1. y(t) =0 
2ytH)=0 


> Solution. Clearly, the constant function y(t) = 0 fort € Risa solution. For the 
second function y(t) = f°, observe that y’ = 31? while 3y?/7 = 3(#°)?/3 = 377. 
Further, y(0) = 0. It follows that both of the functions y(t) = 0 and y(t) = f? are 
solutions of (2). < 


If this differential equation modeled a real-world system, we would have 
problems accurately predicting future states. Should we use y(t) = 0 or y(t) = t7? 
It is even worse than this, for further analysis of this differential equation reveals that 
there are many other solutions from which to choose. (See Example 9.) What is it 
about (2) that allows multiple solutions? More precisely, what conditions could we 
impose on (1) to guarantee that a solution exists and is unique? These questions are 
addressed in Picard’s existence and uniqueness theorem, Theorem 5, stated below. 

Thus far, our method for proving the existence of a solution to an ordinary 
differential equation has been to explicitly find one. This has been a reasonable 
approach for the categories of differential equations we have introduced thus far. 
However, there are many differential equations that do not fall into any of these 
categories, and knowing that a solution exists is a fundamental piece of information 
in the analysis of any given initial value problem. 
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Suppose F(t, y) is a continuous function of (t, y) in the rectangle 
R:={(t, y):a<t<b,c<y<d} 


and (fo, yo) is an interior point of R. The key to the proof of existence and 
uniqueness is the fact that a continuously differentiable function y(f) is a solution 
of (1) if and only if it is a solution of the integral equation 


y(t) = yo +f F(u, y(u)) du. (3) 


To see the equivalence between (1) and (3), assume that y(t) is a solution to (1), so 
that 


y(t) = F(t, y@) 


for all ¢ in an interval containing fo as an interior point and y(to) = yo. Replace ¢ by 
u in this equation, integrate both sides from fp to t, and use the fundamental theorem 
of calculus to get 


/ F(u, y@))du= / y'@au= ¥O= yh) = yO — Yo, 


to i) 


which implies that y(¢) is a solution of (3). Conversely, if y(t) is a continuously 
differentiable solution of (3), it follows that 


g(t) := F(t, y(@)) 


is acontinuous function of ¢ since F(t, y) is a continuous function of t and y. Apply 
the fundamental theorem of calculus to get 


d d : 
y= 590 =F (s0+ [Fe yeoyau) 


d t 
= (> S [ g(u) au) = g(t) = F(t, y(t), 


which is what it means for y(t) to be a solution of (1). Since 


One / " FW ¥@)) die =I, 


y(t) also satisfies the initial value in (1). 
We will refer to (3) as the integral equation corresponding to the initial 
value problem (1) and conversely, (1) is referred to as the initial value problem 
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corresponding to the integral equation (3). What we have shown is that a solution 
to the initial value problem is a solution to the corresponding integral equation and 
vice versa. 


Example 2. Find the integral equation corresponding to the initial value problem 


y=tt+y, y@O)=1. 


> Solution. In this case, F(t, y) = t + y, tf = O and yo = 1. Replace the 
independent variable ¢ by u in F(t, y(t)) to get F(u, y(u)) = u + y(u). Thus, the 
integral equation (3) corresponding to this initial value problem is 


y(t) =1 +f (u+ y(u)) du. < 


For any continuous function y, define 


Ty(t) = yo +f F(u, y(u)) du. 


to 


That is, Jy is the right-hand side of (3) for any continuous function y. Given a 
function y, 7 produces a new function 7 y. If we can find a function y so that 
Ty = y, we say y is afixed point of T. A fixed point y of 7 is precisely a solution 
to (3) since if y = Ty, then 


t 
y=Ty=y+ f Fu, y(u) du, 


i) 


which is what it means to be a solution to (3). To solve equations like the integral 
equation (3), mathematicians have developed a variety of so-called “fixed point 
theorems” for operators such as 7, each of which leads to an existence and/or 
uniqueness result for solutions to an integral equation. One of the oldest and most 
widely used of the existence and uniqueness theorems is due to Emile Picard (1856- 
1941). Assuming that the function F(t, y) is sufficiently “nice,” he first employed 
the method of successive approximations. This method is an iterative procedure 
which begins with a crude approximation of a solution and improves it using a step- 
by-step procedure that brings us as close as we please to an exact and unique solution 
of (3). The process should remind students of Newton’s method where successive 
approximations are used to find numerical solutions to f(t) = c for some function 
Ff and constant c. The algorithmic procedure follows. 


Algorithm 3. Perform the following sequence of steps to produce an approximate 
solution of (3), and hence to the initial value problem, (1). 
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Picard Approximations 


1. A rough initial approximation to a solution of (3) is given by the constant 
function 
yo(t) := Yo. 
2. Insert this initial approximation into the right-hand side of (3) and obtain 
the first approximation 


t 
vit) = yo + ff Fu. solu) au 
to 
3. The next step is to generate the second approximation in the same way, 
that is, 


yo(t) := yo +f F(u, yi(u)) du. 


4. At the nth stage of the process, we have 
t 
alt) = 0+ [Flu ynaw) de 
to 


which is defined by substituting the previous approximation y,—,(f) into 
the right-hand side of (3). 


In terms of the operator 7 introduced above, we can write 


yi =TYyo 
y2= TYy1 _ Tyo 
y= Ty2 = Tyo 


The result is a sequence of functions yo(t), yi(t), y2(t),..., defined on an interval 
containing fy. We will refer to y, as the nth Picard approximation and the sequence 
yo(t), yilt),...,¥n(t) as the first n Picard approximations. Note that the first 
n Picard approximations actually consist of n + 1 functions, since the starting 
approximation yo(t) = yo is included. 


Example 4. Find the first three Picard approximations for the initial value problem 


y=tt+y, yO)=1. 
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> Solution. The corresponding integral equation was computed in Example 2: 


y(t) = 1 +f (u+ y(u)) du. 
0 
We have 
yo(t) = 1 


714 i (u + yo(u)) du 
= 14 Pw nau 
0 


ign( 
2 u 


f #? ? 
ta + + am) 


0 


t u2 t uw 
yalt) = 1+ f (utttu+ 5) au=1+ f (142045) au 
0 2 0 2 
uw . 3 
=14 (u+w+5) =1l4+t4rP+—. 
6) |, 6 


t i t a 
ys) = 1+ f (ue t+utue+ ) du=1+ f (1420402 + 5) du 
0 0 


t 
1+ ieee 
3° 24 


Ae aay 
=1l+r1+P?+i+—. < 
, 3" 24 


It was one of Picard’s great contributions to mathematics when he showed that 
the functions y,(t) converge to a unique, continuously differentiable solution y(t) 
of the integral equation, (3), and thus of the initial value problem, (1), under the mild 
condition that the function F(t, y) and its partial derivative Fy (¢, y) := a F(t, y) 
are continuous functions of (¢, y) on the rectangle R. 


Theorem 5 (Picard’s Existence and Uniqueness Theorem).'* Let F(t, y) and 
Fy(t, y) be continuous functions of (t, y) on a rectangle 


R=({(t,y):ast<b,c<y<d}. 
Tf (to, Yo) is an interior point of R, then there exists a unique solution y(t) of 


y= F(t, y), y(t) = yo, 


3 proof of this theorem can be found in G.R. Simmons’ book Differential Equations with 
Applications and Historical Notes, 2nd edition McGraw-Hill, 1991. 


90 1 First Order Differential Equations 


on some interval [a’,b'] with to € [a',b'| C [a,b]. Moreover, the sequence of 
approximations yo(t) := yo 
i 


yn(t) = Yo + / Gaga eaan 


to 


computed by Algorithm 3 converges uniformly'* to y(t) on the interval |a' , b’). 


Example 6. Consider the initial value problem 
y=tty yO=1. 


For n > 1, find the nth Picard approximation and determine the limiting function 
y = lim,+o ),. Show that this function is a solution and, in fact, the only solution. 


> Solution. In Example 4, we computed the first three Picard approximations: 


t2 
yi(t) = be Eras 


p 
VG) STE pe ea 


Bb ft 
yw) =14ttP $545. 
It is not hard to verify that 
6 ek pe 
t)=1+t+t > = = 
ya(t) see ial +z tpt a 
ee. a r 
=141+2(5 eat gy +s 


and inductively, 


2 3 rt" a. 
m= 141 +2(F 2 anes “)+ 


'4 Uniform convergence is defined as follows: for all € > 0, there exists ny such that the maximal 
distance between the graph of the functions y,(t) and the graph of y(¢) (for ¢ € [a’, b’]) is less 
than ¢€ for all n > no. We will not explore in detail this kind of convergence, but we will note that 


it implies pointwise convergence. That is, for each t € [a’, B’] yn (t) > y(t). 
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t” : : : 
Recall from calculus that e' = }°°° , — > SO the part in parentheses in the expression 
n 


for y,(t) is the first n terms of the expansion of e’ minus the first two: 


See ee ae ee oa ee nies ee (+1) 

2! 3! nl 21" 3! n! 
Thus, 

y(t) = lim y,(t) =14+¢+2(e' —(1+2)) =-1—-142e'. 
noo 

It is easy to verify by direct substitution that y(t) = —1 —¢ + 2e’ is a solution 
to y’ = t + y with initial value y(0) = 1. Moreover, since the equation y’ = 
t + y is a first order linear differential equation, the techniques of Sect. 1.4 show 
that y(t) = —1 —t + 2e’ is the unique solution since it is obtained by an explicit 


formula. Alternatively, Picard’s theorem may be applied as follows. Consider any 
rectangle ® about the point (0, 1). Let F(¢, y) =¢+ y. Then F,(¢, y) = 1. Both 
F(t, y) and F,(¢, y) are continuous functions on the whole (¢, y)-plane and hence 
continuous on 2. Therefore, Picard’s theorem implies that y(t) = lim, +99 yy (ft) is 
the unique solution of the initial value problem 


y=t+y yO=H1. 


Hence, y(t) = —1 —t + 2e' is the only solution. < 


Example 7. Consider the Riccati equation 
y! — a —t 


with initial condition y(0) = 0. Determine whether Picard’s theorem applies on 
a rectangle containing (0,0). What conclusions can be made? Determine the first 
three Picard approximations. 


> Solution. Here, F(t, y) = y? —¢ and F,(t, y) = 2y are continuous on all of 
IR? and hence on any rectangle that contains the origin. Thus, by Picard’s Theorem, 
the initial value problem 


2 
yay =t, pO) =0 
has a unique solution on some interval J containing 0. Picard’s theorem does not 


tell us on what interval the solution is defined, only that there is some interval. 
The direction field for y’ = y* — ¢ with the unique solution through the origin is 
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given below and suggests that the maximal interval [max on which the solution exists 
should be of the form Imax = (a, 0©) for some —co < a < —1. However, without 
further analysis of the problem, we have no precise knowledge about the maximal 
domain of the solution. 

Next we show how Picard’s method of successive approximations works in this 
example. To use this method, we rewrite the initial value problem as an integral 
equation. In this example, F(t, y) = y? — ft, t = 0 and yo = O. Thus, the 
corresponding integral equation is 


10= / Gy ade (4) 


We start with our initial approximation yo(t) = 0, plug it into (4), and obtain our 
first approximation 


yi(t) = fro? - du = - [uu = af 
0 0 2 


The second iteration yields 


f 1 1 1 
yo(t) = i (971 (u)? — u) du = [ (5 - “) du = res - 5 


Since y2(0) = 0 and 


1 1 1 1 
Ge “ag * a  p.e WG,3 TORO 


y2(t)? -t = 


if ¢ is close to 0, it follows that the second iterate y2(t) is already a “good” 
approximation of the exact solution for ¢t close to 0. Since 


1 10 1 TL 
a t 
42. 52 4.5 ‘4 


y2(t)” a 
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it follows that 


is | oo a ree: 
y3(t) = : ps" =a ae + 4H —u) du 


1 11 1 8 1, 
= 11 — t ee 
11-42. 52 Pek ' 4:5 2 


According to Picard’s theorem, the successive approximations y,(t) converge to- 
ward the exact solution y(t), so we expect that y3(t) is an even better approximation 
of y(t) for t close enough to 0. The graphs of y1, y2, and y3 are given below. 


6 8 10 
Direction Field and Solution Solution y(t) and Picard 
for y/ = y?— t, y(0) =0 Approximations 


Yp> Yo, and ys 


Although the Riccati equation looks rather simple in form, its solution cannot be 
obtained by methods developed in this chapter. In fact, the solution is not expressible 
in terms of elementary functions but requires special functions such as the Bessel 
functions. The calculation of the Picard approximations does not reveal a pattern by 
which we might guess what the nth term might be. This is rather typical. Only in 
special cases can we expect to find a such a general formula for y,,. < 


If one only assumes that the function F(t, y) is continuous on the rectangle 
R, but makes no assumptions about F},(t, y), then Guiseppe Peano (1858-1932) 
showed that the initial value problem (1) still has a solution on some interval J with 
to € I C [a,b]. However, in this case, the solutions are not necessarily unique. 


Theorem 8 (Peano’s Existence Theorem!>). Let F(t, y) be a continuous func- 
tions of (t, y) on a rectangle 


For a proof see, for example, A.N. Kolmogorov and S.V. Fomin, Introductory Real Analysis, 
Chap. 3, Sect. 11, Dover 1975. 
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R={@,y):a<t<b,c<y<d}. 
Tf (to, Yo) is an interior point of R, then there exists a solution y(t) of 


y= F(t, y), y(to) = yo. 


on some interval |a’, b'] with ty € [a’, b’| C [a, B]. 
Let us reconsider the differential equation introduced in Example 1. 


Example 9. Consider the initial value problem 


2/3 

y= 3y?, y(t) = yo. (5) 
Discuss the application of Picard’s existence and uniqueness theorem and Peano’s 
existence theorem. 


> Solution. The function F(t, y) = 3y2/? is continuous for all (¢, y), so Peano’s 
existence theorem shows that the initial value problem (5) has a solution for all 
possible initial values y(to) = yo. Moreover, Fy(t, y) = a is continuous on 
any rectangle not containing a point of the form (t, 0). Thus, Picard’s existence and 
uniqueness theorem tells us that the solutions of (5) are unique as long as the initial 
value yo is nonzero. Assume that yo 4 0. Since the differential equation y’ = 3y?/? 


is separable, we can rewrite it in the differential form 
1 


and integrate the differential form to get 


1/3 


3y/* = 3t+e. 


Thus, the functions y(t) = (t +c)? fort € R are solutions for y’ = 3y?/?. Clearly, 
the equilibrium solution y(t) = 0 does not satisfy the initial condition. The constant 
c is determined by y(t) = yo. We getc = va 16; and thus y(t) = (¢ +y,/? to)? 
is the unique solution of if yo # 0. If yo = 0, then (5) admits more than one solution. 
Two of them are given in Example |. However, there are many more. In fact, the 
following functions are all solutions: 


(t-—ay> ift<a 
y(t) = 40 ifa<t<B (6) 
(t-—By ift>B, 
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where ty € [a, 6]. The graph of one of these functions (where a = —1, B = 1) 
is depicted below. What changes among the different functions is the length of the 
straight line segment joining a to 6 on the t-axis. 


Graph of Equation (6) 
a=-—landG=1 


< 


Picard’s theorem, Theorem 5, is called a local existence and uniqueness theorem 
because it guarantees the existence of a unique solution in some subinterval J C 
[a, b]. In contrast, the following important variant of Picard’s theorem yields a 
unique solution on the whole interval [a, b]. 


Theorem 10. Let F(t, y) be a continuous function of (t, y) that satisfies a 
Lipschitz condition on a strip S = {(t, y): a <t <b, -—c < y < oo}. That is, 
assume that 


|F(t, 1) — F(t, y2)| < Kly1 — y2| 


for some constant K > 0 and for all (t, y,) and (t, y2) in S. If (to, yo) is an interior 
point of S, then there exists a unique solution of 


y=F(t,y), y(t) = yo, 


on the interval [a, b]. 


Example 11. Show that the following differential equations have unique solutions 
on all of R: 


1. y! = esinty | y(0) —0 
2. y’ =|ty|, y(0) =0 
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> Solution. For each differential equation, we will show that Theorem 10 applies 
on the strip S = {(t, y) : -a < t < a, —o© < y < oo} and thus guarantees 
a unique solution on the interval [—a,a]. Since a is arbitrary, the solution exists 
on R. 


1. Let F(t, y) = e"”’. Here we will use the fact that the partial derivative of F 
with respect to y exists so we can apply the mean value theorem: 


F(t, y1) — F(t, y2) = Fy(t, Yo) — 2), (7) 


where y, and y2 are real numbers with yo between y, and yz. Now focus on the 
partial derivative F,(t, y) = ent cos(ty). Since the exponential function is 
increasing, the largest value of e“” occurs when sin is at its maximum value of 
1. Since |costy| < 1 and |t| < a, we have FG y)| = let costy| <ela= 
ea. Now take the absolute value of (7) to get 


|F(t, 1) _ F(t, y>)| 22 len = efinty2| <ea ly _ yo| . 


It follows that F(t, y) = e%""” satisfies the Lipschitz condition with K = ea. 
Theorem 10 now implies that y’ = e%"”’, with y(0) = 0 has a unique solution 
on the interval [—a, a]. Since a is arbitrary, a solution exists and is unique on all 
of R. 

2. Let F(t, y) = |ty|. Here F does not have a partial derivative at (0,0). 
Nevertheless, it satisfies a Lipschitz condition for 


|F(t, v1) — F(t, y2)| = [Iti] — |tyall < |tl|y1 — v2] S aly — yal, 


since the maximum value of ¢ on [—a, a] is a. It follows that F(t, y) = |ty| 
satisfies the Lipschitz condition with K = a. Theorem 10 now implies that 


y =\ty| y(@)=0, 


has a unique solution on the interval [—a, a]. Since a is arbitrary, a solution exists 
and is unique on all of R. < 


Remark 12. 

1. When Picard’s theorem is applied to the initial value problem y’ = e*"”’, y(0) = 
0, we can only conclude that there is a unique solution in an interval about the 
origin. Theorem 10 thus tells us much more, namely, that the solution is in fact 
defined on the entire real line. 

2. In the case of y’ = |ty|, y(O) = 0, Picard’s theorem does not apply at all since 
the absolute value function is not differentiable at 0. Nevertheless, Theorem 10 
tells us that a unique solution exists on all of R. Now that you know this, can you 
guess what that unique solution is? 
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The Geometric Meaning of Uniqueness 


The theorem on existence and uniqueness of solutions of differential equations, 
Theorem 5, has a particularly useful geometric interpretation. Suppose that y’ = 
F(t, y) is a first order differential equation for which Picard’s theorem applies. If 
y(t) and y2(t) denote two different solutions of y’ = F(t, y), then the graphs of 
yi(t) and y2(t) can never intersect. The reason for this is just that if (fo, yo) is a 
point of the plane which is common to both the graph of y,(¢) and that of yo(t), 
then both of these functions will satisfy the initial value problem 


y= F(t, y), y(to) = yo. 


But if y)(¢) and y(t) are different functions, this will violate the uniqueness 
provision of Picard’s theorem. 
To underscore this point, consider the following contrasting example: The 
differential equation 
ty = 3y (8) 


is linear (and separable). Thus, it is easy to see that y(t) = cf? is its general solution. 
In standard form, (8) is 


yo (9) 


and the right-hand side, F(t, y) = 3y/t, is continuous provided t # 0. Thus, 
assuming t # 0, Picard’s theorem applies to give the conclusion that the initial 
value problem y’ = 3y/t, y(to) = yo has a unique local solution, given by y(t) = 
(yo/ ip )t?. However, if f9 = 0, Picard’s theorem provides no information about the 
existence and uniqueness of solutions. Indeed, in its standard form, (9), it is not 
meaningful to talk about solutions of this equation at t = 0 since F(t, y) = 3y/t 
is not even defined for t+ = O. But in the originally designated form, (8), where 
the ¢ appears as multiplication on the left side of the equation, then an initial value 
problem starting at ¢ = 0 makes sense, and moreover, the initial value problem 


ty’=3y, y(0)=0 


has infinitely many solutions of the form y(t) = ct? for any c € R, whereas the 
initial value problem 


ty’ =3y, y()= yo 
has no solution if yo 4 0. See the figure below, where we have graphed the function 


y(t) = ct? for several values of c. Notice that all of them pass through the origin 
(i.e., y(0) = 0), but none pass through any other point on the y-axis. 
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Thus, the situation depicted above where several solutions of the same differen- 
tial equation go through the same point (in this case (0,0)) can never occur for a 
differential equation which satisfies the hypotheses of Theorem 5. 

The above remark can be exploited in the following way. The constant function 
yi(t) = 0 is clearly a solution to the differential equation y’ = y? + y. Since 
F(t, y) = y? + y has continuous partial derivatives, Picard’s theorem applies. 
Hence, if y2(t) is a solution of the equation for which y2(0) = 1, the above 
observation takes the form of stating that y2(t) > 0 for all t. This is because, in 
order for y(t) to ever be negative, it must first cross the t-axis, which is the graph 
of y;(¢), and we have observed that two solutions of the same differential equation 
can never cross. 
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Exercises 


1-4. Write the corresponding integral equation for each of the following initial value 
problems. 


1. y’=ty, yO)=1 
/ 


2. wv =y? y(0)=-1 
3 (= y(0) =1 
t+y’ 

4. y'=1+27, y(0)=0 


5-9. Find the first n Picard approximations for the following initial value problems. 


5. y =ty, yO)=1, n=3 

6. yw =t-y, yO)=1, n=4 

7. y=t+y*, yO)=0, n=3 

8 yw =y-y, yO=1, n=3 

9. y=1+(t-y), yO)=0, n=5 


10-14. Which of the following initial value problems are guaranteed a unique 
solution by Picard’s theorem (Theorem 5)? Explain. 


10. yy =1+y7, y(0)=0 


I. y= Vy yl) =0 
12. y= Jy, y(0)=1 
f—y 
13. y’ = ——, 0)=-!1 
ae see y(0) 
t—y 
14. y’ = ——, 1)=-1 
ars" y(1) 
15. Determine a formula for the nth Picard approximation for the initial value 
problem 


y =ay, y(0)=1, 


where a € R. What is the limiting function y(t) = lim, y,(t). Is it a 
solution? Are there other solutions that we may have missed? 
16. (a) Find the exact solution of the initial value problem 


y=, yO) =1, 


(b) Calculate the first three Picard approximations y,(t), y2(t), and y3(t) and 
compare these results with the exact solution. 
17. Determine whether the initial value problem 


y’ =cos(t+y), y(to) = yo. 


has a unique solution defined on all of R. 
18. Consider the linear differential equation y’ + p(t)y = f(t), with initial 
condition y(to) = yo, where p(t) and f(t) are continuous on an interval 
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19. 


20. 


21. 


22. 


23. 
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I = [a,b] containing fp) as an interior point. Use Theorem 10 to show that 
there is unique solution defined on [a, b]. 
(a) Find the general solution of the differential equation 


ty’ =2y—-t. 


Sketch several specific solutions from this general solution. 

Show that there is no solution satisfying the initial condition y(0) = 2. 
Why does this not contradict Theorem 5? 

(a) Let to, yo be arbitrary and consider the initial value problem 


(b 


wm 


/ 


y=y*, y(to) = yo. 


Explain why Theorem 5 guarantees that this initial value problem has a 
solution on some interval |t — fo| < A. 

Since F(t, y) = y? and F,(¢, y) = 2y are continuous on all of the 
(t, y)—plane, one might hope that the solutions are defined for all real 
numbers t. Show that this is not the case by finding a solution of y’ = y? 
which is defined for all ¢ € R and another solution which is not defined for 
all ¢ € R. (Hint: Find the solutions with (fo, yo) = (0, 0) and (0, 1).) 

Is it possible to find a function F(t, y) that is continuous and has a continuous 
partial derivative F(t, y) on a rectangle containing the origin such that the two 
functions y;(¢) = ¢ and y2(t) = ¢? — 2¢ are both solutions to y’ = F(t, y) on 
an interval containing 0? 

Is it possible to find a function F(t, y) that is continuous and has a continuous 
partial derivative F(t, y) on a rectangle containing (0,1) such that the two 
functions y;(t) = (¢ + 1)? and the constant function y(t) = 1 are both 
solutions to y’ = F(t, y) on an interval containing 0? 

Show that the function 


(b 


wm 


0, fort <0 


yi(t) = 
te fort >0 


is a solution of the initial value problem ty’ = 3y, y(0) = 0. Show that y2(t) = 
0 for all ¢ is a second solution. Explain why this does not contradict Theorem 5. 


Chapter 2 
The Laplace Transform 


2.1 Laplace Transform Method: Introduction 


The method for solving a first order linear differential equation y’ + p(t)y = f(t) 
(Algorithm 3 of Sect.5) involves multiplying the equation by an integrating factor 
L(t) = e! P(4t chosen so that the left-hand side of the resulting equation becomes 
a perfect derivative (j1(t)y)’. Then the unknown function y(t) can be retrieved by 
integration. When p(t) = k is a constant, y(t) = eX is an exponential function. 
Unfortunately, for higher order linear equations, there is not a corresponding type of 
integrating factor. There is, however, a useful method involving multiplication by an 
exponential function that can be used for solving an nth order constant coefficient 
linear differential equation, that is, an equation 


y + ayy") ++.» tay’ +aoy = F(t) (1) 


in which ao, a, ..., Gn—1 are constants. The method proceeds by multiplying (1) 
by the exponential term e~*’, where s is another variable, and then integrating the 
resulting equation from 0 to oo, to obtain the following equation involving the 
variable s: 


lo) lo.) 
/ et (y™ + ayy") +++» +a1y’ +aoy) dt = / e' f(t)dt. (2) 
0 0 


The integral bas e*' f(t) dt is called the Laplace transform of f(t), and we will 
denote the Laplace transform of the function f(t) by means of the corresponding 
capital letter F(s) or the symbol £ { f(t)} (s). Thus, 


Lif} (s) = i, oe f(t) dt = F(s). 3) 


W.A. Adkins and M.G. Davidson, Ordinary Differential Equations, 101 
Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-3618-8_2, 
© Springer Science+Business Media New York 2012 
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Note that F'(s) is a function of the new variable s, while the original function f(t) 
is a function of the variable ¢. The integral involved is an improper integral since the 
domain of integration is of infinite length; at this point, we will simply assume that 
the integrals in question exist for all real s greater than some constant a. 

Before investigating the left-hand side of (2), we will first calculate a couple of 
simple Laplace transforms to see what the functions F(s) may look like. 


Example 1. Find the Laplace transform of f(t) = e“’ and g(t) = te”. 


> Solution. First, we find the Laplace transform of f(t) = e”’. 
[e,) 
F(s) = L{f()} (s) = i ee” dt 
0 


Co 1 
= / edt = lim |e” dt 
0 


roo Jo 
e(a-s)t 7 e(a-s)r 1 
= lim = lim - 
roo a—S | roo \la-s a-s 
1 el(a-s)r 
= lim 
S-a rox a-s 
1 
s—a’ 


provided a —s < 0, that is, s > a. In this situation, the limit of the exponential term 
is 0. Therefore, 


Lie {o)= 


fors >a. (4) 
sS—a 


A similar calculation gives the Laplace transform of g(t) = te“’, except that 
integration by parts will be needed in the calculation: 


[eve) lee) 
J est (te”’) dt = / telat dt 
0 0 
; tea-s)t fi 
roo a-s 


r el(a-s)t 
-f dt 
0 0 a—s 


te(@-s)t e(a-s)t ie 
= lim _ | 
a-s (a—s)* Jo 


; re(-9)r e(a-s)r : 1 
rool a—s  (a-—s)? (a—s)? 


= —__ fors >a. 


II 


G(s) = L£ {te} (s) 


] 
5 


] 
5 
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Therefore, 


at = 1 
£ {te ios Goa? fors >a. (5) 
< 


In each of these formulas, the parameter a represents any real number. Thus, 
some specific examples of (4) and (5) are 


cu}= s>0O a=0Oin(4), 
e{e}=— s>2 a=2in(4), 
Lf} = s>—2 a=-—2in(4), 
LiW=5 s>0O az=0Oin(5), 
£fte} = s>2 az=2in(5), 
Lie = <5 s>—2 a=-—2in(5). 


We now turn to the left-hand side of (2). Since the integral is additive, we can 
write the left-hand side as a sum of terms 


af ey dt = aj Ll {Ly (s). (6) 
0 


For now, we will not worry about whether the solution function y(t) is such that 
the Laplace transform of y) exists. Ignoring the constant, the 7 = 0 term is 
the Laplace transform of y(t), which we denote by Y(s), and the 7 = 1 term 
is the Laplace transform of y’(t), and this can also be expressed in terms of 
Y(s) = £L{y(t)} (s) by use of integration by parts: 


CO lo. @) 
/ e y'(t)dt = e“y(t)|>° + sf e y(t) dt 
0 0 


lim e y(t) — y(0) + sY(s). 

too 

We will now further restrict the type of functions that we consider by requiring that 
lim e“ y(t) = 0. 
too 


We then conclude that 


L£iy'®} (s) = / e-** y'(s) dt = s¥(s) — yO). (7) 
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Table 2.1 Basic Laplace 


transform formulas ee 
iB 1 <> - 
Ss 
n n! 
2 t <—_ art 
3 et <> ! 
s—a 
n! 
oS — ES et 
5. cos bt <-> ao 
. b 
6. sin bt <-> oR 
7. af(t)+bg(t) <>  aF(s) + bG(s) 
8. y(t) <>  s¥(s)—y(0) 
9. y(t) <> 8 ¥(s)—sy(0) — yO) 


By use of repeated integration by parts, it is possible to express the Laplace 
transforms of all of the derivatives y) in terms of Y(s) and values of y(t) at 
t = 0. The formula is 


L{yM@} (s) = [omy dt 


= s"¥(s) — (5""'y@) + 5" y' +--+ 5y""O + y""), 
(8) 


with the important special case forn = 2 being 
L ty" (t)} (8) = s°¥(s) — sy(0) — y'(0). (9) 


The Laplace transform method for solving (1) is to use (8) to replace each 
Laplace transform of a derivative of y(t) in (2) with an expression involving Y(s) 
and initial values. This gives an algebraic equation in Y(s). Solve for Y(s), and 
hopefully recognize Y(s) as the Laplace transform of a known function y(t). This 
latter recognition involves having a good knowledge of Laplace transforms of a 
wide variety of functions, which can be manifested by means of a table of Laplace 
transforms. A small table of Laplace transforms, Table 2.1, is included here for use 
in some examples. The table will be developed fully and substantially expanded, 
starting in the next section. For now, we will illustrate the Laplace transform method 
by solving some differential equations of orders | and 2. The examples of order 1 
could also be solved by the methods of Chap. 1. 


Example 2. Solve the initial value problem 
y+2y=e™, yy) =0, (10) 


by the Laplace transform method. 
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> Solution. As in (2), apply the Laplace transform to both sides of the given 
differential equation. Thus, 


L{y' + 2y}(s) = £ fe} (9). (11) 
The right-hand side of this equation is 


Ble) = ss 


which follows from (4) with a = —2. The left-hand side of (11) is 
L£ fy! + 2y}(s) = L£{y’} + 2£ {y} = s¥(s) — yO) + 2Y(s) = (s +. 2)¥(5), 
where Y(s) = L£ {y(t)} (s). Thus, (11) becomes 


(s +2)¥(s) = ——, 


s+2 
which can be solved for Y(s) to give 
Y(s) = ——— . 
(s) (s + 2)? 
From (5) with a = —2, we see that Y(s) = L oma (s), which suggests that 
y(t) = te~2", By direct substitution, we can check that y(t) = te”! is, in fact, the 
solution of the initial value problem (10). < 


Example 3. Solve the second order initial value problem 
y”’ +4y =0, y(0)=1, y’(0) =0, (12) 


by the Laplace transform method. 


> Solution. As in the previous example, apply the Laplace transform to both sides 
of the given differential equation. Thus, 


L{y" + 4y} (s) = L{0} = 0. (13) 


The left-hand side is 


L{y" + 4y}(s) 


Lfy" + 4L£ fy} = s°¥(s) — sy(0) — yO) + 4¥(s) 
—s + (s? + 4)Y(s), 


where Y(s) = L {y(t)} (s). Thus, (13) becomes 


(s? + 4)Y(s) —s =0, 
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which can be solved for Y(s) to give 


Ss 


Y(s) = ——_. 
©) s7+4 


Item 5, with b = 2, in Table 2.1, shows that Y(s) = L {cos 2t} (s), which suggests 
that the solution y(t) of the differential equation is y(t) = cos 2t. Straightforward 
substitution again shows that this function satisfies the initial value problem. < 


Here is a slightly more complicated example. 
Example 4. Use the Laplace transform method to solve 


y" + 4y’ + 4y = 2te, (14) 


with initial conditions y(0) = | and y’(0) = —3. 


> Solution. Let Y(s) = L{y(t)} where, as usual, y(t) is the unknown solution. 
Applying the Laplace transform to both sides of (14) gives 


L ity” + 4y' + 4y} (9) = L£ {2te"} —" 


which, after applying items 7-9 from Table 2.1 to the left-hand side, and item 4 to 
the right-hand side, gives 


2 ees 
s°Y(s) — sy(0) — y'(0) + 4(s¥(s) — y(0)) + 4¥(s) = (s+ 22" 


Now, substituting the initial values gives the algebraic equation 


(8) —s +3 + 4(s¥(s) — 1) +4¥(5) = oa De 


Collecting terms, we get 


2 = _ 
(s° +45 + 4)Y(s) =s+14+ G42 


and solving for Y(s), we get 


a s+1 2 
YS) = Gap t Ga 


This Y(s) is not immediately recognizable as a term in the table of Laplace 
transforms. However, a simple partial fraction decomposition, which will be studied 
in more detail later in this chapter, gives 
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stl 2 

G+22 1 @+24 

_ @+2)-1 2 

(se +2) © (s +.2)4 
1 1 2 
go Gao Gao 


Y(s) = 


Each of these terms can be identified as the Laplace transform of a function in 
Table 2.1. That is, item 4 with a = —2 andn = 0, 1, and 3 gives 


. ; 7 i a 3! 
£ fe} (s) = 5, L fre 10) = Cap and £ {t*e = aa 


Thus, we recognize 
Y¥(s) =Lie* —te # + —Pe #4 , 


which suggests that 


y(t) = e 2! _ te 2! 1 3 a 


is the solution to (14). As before, substitution shows that this function is in fact a so- 
lution to the initial value problem. | 


The examples given illustrate how to use the Laplace transform to solve the nth 
order constant coefficient linear differential equation (1). The steps are summarized 
as the following algorithm. 


Algorithm 5. Use the following sequence of steps to solve (1) by means of the 
Laplace transform. 


Laplace Transform Method 


1. Set the Laplace transform of the left-hand side of the equation equal to the 
Laplace transform of the function on the right-hand side. 

2. Letting Y(s) = £{y(t)}(s), where y(t) is the unknown solution to (1), 
use the derivative formulas for the Laplace transform to express the 
Laplace transform of the left-hand side of the equation as a function 
involving Y(s), some powers of s, and the initial values y(0), y’(0), etc. 

3. Now solve the resulting algebraic equation for Y(s). 

4. Identify Y(s) as the Laplace transform of a known function y(t). This may 
involve some algebraic manipulations of Y(s), such as partial fractions, for 
example, so that you may identify individual parts of Y(s) from a table of 
Laplace transforms, such as the short Table 2.1 reproduced above. 
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The Laplace transform is quite powerful for the types of differential equations to 
which it applies. However, steps | and 4 in the above summary will require a more 
extensive understanding of Laplace transforms than the brief introduction we have 
presented here. We will start to develop this understanding in the next section. 
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1-14. Solve each of the following differential equations using the Laplace trans- 
form method. Determine both Y(s) = L {y(t)} and the solution y(f). 


1. y’-4y=0, y(0)=2 

2. y-4y=1, y(0)=0 

3. y’—4y =e”, y(0)=0 

4. y'’+ay=e", yO=1 

5. y’ +2y =3e', y(0)=2 

6. y+2y=te*, y(0)=0 

7. y’+3y’+2y=0, y(0) = 3, y’(0) = —-6 
8. y’+5y'+6y=0, y(0) =2, y'(0) =—6 
9. y’+25y=0, y(0)=1, y’(0)=-1 
10. y’+ay=0, yO=y,YO=yn 
ll. y’+8y’+ 16y=0, y(0)=1, y'(0)=—4 
12. y’ —4y’ + 4y = 4e”", (0) = —1, y'(0) = —4 
13. y’+4y’+4y=e%, y(0)=0,y(0)=1 
14. y"+4y=8, y(0)=2,y/0)=1 
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Suppose f(t) is a continuous function defined for all f > 0. The Laplace transform 
of f is the function F(s) = £{ f(t)} (s) defined by the improper integral equation 


FQ) = £1f0}0) = fe fQaee= Jim fe foe W) 


provided the limit exists at s. It can be shown that if the Laplace transform exists at 
s = N, then it exists for all s > N.! This means that there is a smallest number N, 
which will depend on the function /, so that the limit exists whenever s > N. 

Let us consider this equation somewhat further. The function f with which 
we start will sometimes be called the input function. Generally, “t” will denote 
the variable for an input function f, while the Laplace transform of f, denoted 
L{f(t)} (s),” is anew function (the output function or transform function), whose 
variable will usually be “s”. Thus, (1) is a formula for computing the value of the 
function £ { f} at the particular point s, so that, for example, F(2) = £{f}(2) = 
i e * f(t) dt provided s = 2 is in the domain of L{ f(t)}. 

When possible, we will use a lowercase letter to denote the input function 
and the corresponding uppercase letter to denote its Laplace transform. Thus, F(s) 
is the Laplace transform of f(t), Y(s) is the Laplace transform of y(t), etc. Hence, 
there are two distinct notations that we will be using for the Laplace transform of 
F(t); if there is no confusion, we use F(s), otherwise we will write £L { f(t)} (s). 

To avoid the notation becoming too heavy-handed, we will frequently write 
L{f} rather than £{f}(s). That is, the variable s may be suppressed when the 
meaning is clear. It is also worth emphasizing that, while the input function f must 
have a domain that includes [0, oo), the Laplace transform £{ f}(s) = F(s) is 
only defined for all sufficiently large s, and the domain will depend on the particular 
input function f. In practice, this will not be an issue, and we will generally not 
emphasize the particular domain of F(s). 


Functions of Exponential Type 


The fact that the Laplace transform is given by an improper integral imposes 
restrictions on the growth of the integrand in order to insure convergence. A function 


‘A nice proof of this fact can be found on page 442 of the text Advanced Calculus (second edition) 
by David Widder, published by Prentice Hall (1961). 


Technically, f is the function while f(t) is the value of the function f at f. Thus, to be correct, the 


notation should be L { f} (s). However, there are times when the variable ¢ needs to be emphasized 
or f is given by a formula such as in £ {e" \(s). Thus, we will freely use both notations: 


L{f(t)} (s) and Lf f} (s). 
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F on [0, 00) is said to be of exponential type with order a if there is a constant K 
such that 
|f@| < Ke® 


for all t € [0, co). If the order is not important to the discussion, we will just say f 
is of exponential type. The idea here is to limit the kind of growth that we allow f 
to have; it cannot grow faster than a multiple of an exponential function. The above 
inequality means 


—Ke™ < f(t) < Ke, 


for all t € [0, 00) as illustrated in the graph below. Specifically, the curve, f(t), lies 
between the upper and lower exponential functions, —Ke“’ and Ke“. 


—Keat 


As we will see below, limiting growth in this way will assure us that f has 
a Laplace transform. If f(t) is a bounded function, then there is a K so that 
| f(t)| < K which implies that f(t) is of exponential type of order a = 0. Hence, 
all bounded functions are of exponential type. For example, constant functions, 
cos bt and sin bt are of exponential type since they are bounded. Notice that if f 
is of exponential type of order a anda < 0, then lim;+o. f(t) = 0 and hence 
it is bounded. Since exponential type is a concept used to restrict the growth of a 
function, we will be interested only in exponential type of order a > 0. 

The set of all functions of exponential type has the property that it is closed 
under addition and scalar multiplication. We will often see this property on sets of 
functions. A set F of functions (usually defined on some interval J) is a linear 
space (or vector space) if it is closed under addition and scalar multiplication. More 
specifically, F is a linear space if 


* Athef, 
L ch €F, 
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whenever f|, fo € F and c is a scalar. If the scalars in use are the real numbers, 
then ¥ is referred to as a real linear space. If the scalars are the complex numbers, 
then F is a complex linear space. Unless otherwise stated, linear spaces will be real. 


Proposition 1. The set of functions of exponential type is a linear space. 


Proof. Suppose f; and f2 are of exponential type and c € R is a scalar. Then there 
are constants K;, K>, a;, and a> so that f\(t) < Kye!’ and fa(t) < Ke%'. Now 
let K = K, + Kz and let a be the larger of a; and a2. Then 


IAM + AMO! S|IAOL+ AW! < Kiet! + Kye! < Kye" + Kre = Ke™. 
It follows that f, + fo is of exponential type. Further, 
IcA@!| < IelLA@I = le] Ke’. 


It follows that c f| is of exponential type. Thus, the set of all functions of exponential 
type is closed under addition and scalar multiplication, that is, is a linear space. O 


Lemma 2. Suppose f is of exponential type of order a. Let s > a, then 


lim f(He" = 0. 
too 
Proof. Choose K so that | f(t)| < Ke“’. Lets > a. Then 


< Ke &-, 


| fie | = IO) ay 
e 


Taking limits gives the result since lim;+9.e°~®" = 0 because —(s—a) <0. O 


Proposition 3. Let f be a continuous function of exponential type with order a. 
Then the Laplace transform F(s) = L{ f(t)}(s) exists for all s > a and, moreover, 
lims+o0 F(s) = 0. 


Proof. Let f be of exponential type of order a. Then | f(t)| < Ke“, for some K, 
so | f(t)e""| < Ke~&—®" and 


Fol =| fe" roa 


oe) CO K 
</ ew [polars K [ota =, 
0 0 sS—a 
provided s > a. This shows that the integral converges absolutely, and hence the 
Laplace transform F(s) exists for s > a, and in fact | F(s)| < K/(s — a). Since 
lim,-+9 K/(s — a) = 0, it follows that lim,;_,.o F(s) = 0. oO 


It should be noted that many functions are not of exponential type. For example, 
in Exercises 39 and 40, you are asked to show that the function y(t) = e" is not of 
exponential type and does not have a Laplace transform. Proposition 3 should not be 
misunderstood. The restriction that f be of exponential type is a sufficient condition 
to guarantee that the Laplace transform exists. If a function is not of exponential 
type, it still may have a Laplace transform. See, for example, Exercise 41. 
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Lemma 4. Suppose f is a continuous function defined on [0, 00) of exponential 
type of order a > 0. Then any antiderivative of f is also of exponential type and 
has order a ifa > 0. 


Proof. Suppose | f(t)| < Ke“, for some K and a. Let g(t) = i J(u) du. Suppose 
a > 0. Then 


ib t K K 
els f lfwlaus [ Ke™du= Ce" —1) = Ze", 
0 0 a a 


It follows that g is of exponential type of order a. If a = 0, then | f| < K for some 
K. The antiderivative g defined above satisfies |g| < Kt. Let b > 0. Then since 
u < e” (for u nonnegative), we have bt < e”’. So|g| < Kt < (K/b)e”". It follows 
that g is of exponential type of order b for any positive b. Since any antiderivative 
of f has the form g(t) + C for some constant C and constant functions are of 
exponential type, the lemma follows by Proposition 1. < 


We will restrict our attention to continuous input functions in this chapter. In 
Chap. 6, we ease this restriction and consider Laplace transforms of discontinuous 
functions. 


Basic Principles and Formulas 


A particularly useful property of the Laplace transform, both theoretically and 
computationally, is that of linearity. Specifically, 


Theorem 5. The Laplace transform is linear. In other words, if f and g are 
functions of exponential type and a and b are constants, then 


Linearity of the Laplace Transform 


Liaf + bg} =aLl{f}+bLl {g}. 


Proof. By Proposition 1, the function af + bg is of exponential type and, by 
Proposition 3, has a Laplace transform. Since (improper) integration is linear, we 
have 


Lfaf + bg}(s) = i e"(af (t) + bg(t)) dt 


= af ee f(t) dt + of e g(t) dt 


= al{f}(s) + bL{g}(s). oO 
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The input derivative principles we derive below are the cornerstone principles of 
the Laplace transform. They are used to derive basic Laplace transform formulas 
and are the key to the Laplace transform method to solve differential equations. 


Theorem 6. Suppose f(t) is a differentiable function on [0, co) whose derivative 
F'(t) is continuous and of exponential type of order a > 0. Then 


The Input Derivative Principle 
The First Derivative 


LIF (O))} (9) = sLifO}O)- FO), s >a. 


Proof. By Lemma 4, f(t) is of exponential type. By Proposition 3, both f(t) and 
f‘(t) have Laplace transforms. Using integration by parts (let u = e’, dv = 


f'(t) dt), we get 
i ee’ f(t) dt 
0 


— e f(0)|5° -| —se" f(t) dt 


Lif} () 


II 


—f(0) +s fe" Fat = SLI FO} 6)~ FO, 
For a function g(t) defined of [a, 00), we use the notation g(t)|°° to mean 
lim (g(t) — g(a). < 


Observe that if f’(t) also satisfies the conditions of the input derivative principle, 
then we get 


Lif} (8) = sL{f' Of - f'O) 
= s(sL{f(}— fO) — fF’) 
= SLi f(t} —sfO)— f'O). 
We thus get the following corollary: 


Corollary 7. Suppose f(t) is a differentiable function on [0, co) with continuous 
second derivative of exponential type of order a => 0. Then 


Input Derivative Principle 
The Second Derivative 


LIF" (t)} (8s) = LIF} (8s) -—sfO)— f'0), ss >a. 
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Repeated applications of Theorem 6 give the following: 


Corollary 8. Suppose f(t) is a differentiable function on |0, 00) with continuous 
nth derivative of exponential type of order a = 0. Then 


Input Derivative Principle 
The nth Derivative 


L{SO} = s"LEFO} 8" FO —---— sf" PO) - f°, 


fors >a. 


We now compute the Laplace transform of some specific input functions that will 
be used frequently throughout the text. 


Formula 9. Verify the Laplace transform formula: 


Constant Functions 


LUO) ==, s>0. 


V Verification. For the constant function 1, we have 


[oe] —ts |! 
L{l}(s) = i e.1dt = lim 
0 r>00 —S |g 
Ts _ | 1 
= lim = fors > 0. A 
roo —s S 


For the limit above, we have used the basic fact that 


lim e’* = 
roo 


0 ifc<0 
co ifc>0. 


Formula 10. Assume n is a nonnegative integer. Verify the Laplace transform 
formula: 


Power Functions 


4 n! 
Lit }O) = s>0. 


V Verification. Let b > 0. Since u < e" for u > 0, it follows that bt < e?' for 
allt > 0. Thus, t < e%/b and t” < e?”'/b”. Since b is any positive number, 
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it follows that t” is of exponential type of order a for all a > O and thus has a 
Laplace transform for s > 0. Let f(t) = t” and observe that f“(0) = 0 for 
k =1,...,n—1and f(t) = n!. Apply the nth order input derivative formula, 
Corollary 8, to get 


n 


pais 


S 
=L£{f"O}@ 
— s"L{t"} — s"| £0) ee f"%0) 
= s"L{t"}(s). 
It follows that 
Le}@= 2, s>0. A 


Example 11. Find the Laplace transform of 
f(t) =3—4t + 627. 


> Solution. Here we use the linearity and the basic Laplace transforms determined 
above: 


L{3—4t + of} = 3L{1}-4L {0} 4+ 6£ {r} 


0) 


3 4 36 


II 


The formula for the Laplace transform of t” is actually valid even if the exponent 
is not an integer. Suppose that a € R is any real number. Then use the substitution 
t = x/s in the Laplace transform integral to get 


ay _ a —st _ —x _ a,x 
ceny= [ t*e a= (=) e =n | x"e “dx (s > 0). 


The improper integral on the right converges as long as a > —1, and it defines a 
function known as the gamma function or generalized factorial function evaluated 
ata + 1. Thus, (8) = oa x'-le-* dx is defined for B > 0, and the Laplace 
transform of the general power function is as follows: 
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Formula 12. If ~ > —1, then 


General Power Functions 


(a+) 


LEY) = 


s>0. 


If 1 is a positive integer, then "(mn + 1) = n! (see Exercise 42) so Formula 10 is 
a special case of Formula 12. 


Formula 13. Assume a € R. Verify the Laplace transform formula: 


Exponential Functions 


1 
Li{e}(s) = ; gs>a. 
sS—a 
V Verification. If s > a, then 
ioe) lo) e7S—a)t oo 1 
£ fe} (8) = i ee di i, eae = . fo 
0 0 —(s — a) |p s-a 


Formula 14. Let b € R. Verify the Laplace transform formulas: 


Cosine Functions 


L {cos bt} (s) = for s > 0. 


s 
s2 +b?’ 


and 


Sine Functions 


b 
L {sin bt} (s) = Pak for s > 0. 


V Verification. Since both sin bt and cos bt are bounded continuous functions, they 
are of exponential type and hence have Laplace transforms. Let f(t) = cos bt. Then 
f(t) = —bsinbt and f(t) = —b? cos bt. The input derivative principle for the 
second derivative, Corollary 7, implies 


—b°L {cos bt} (8) = LYS" (t)} (8) = LL FW} — sf) — f'O) 


= s*L {cos bt} — s(1) — (0) 
= s*£ {cos bt}—s. 
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Now subtract s*L {cos bt} from both sides and combine terms to get 
—(s? + b*)L {cos bt} = —s. 


Solving for £ {cos bt} gives 


s 
L£ {cos bt} = ——~. 
{ } s? + b? 
A similar calculation verifies the formula for £ {sin bt}. A 


Example 15. Find the Laplace transform of 


Qe” + 3cos2t — 4sin 31. 


> Solution. We use the linearity of the Laplace transform together with the 
formulas derived above to get 


II 


L£ {2e + 3cos2t — 4sin3r} = 2£ {e%} + 3L {cos 21} — 4L {sin 37} 


2 4 35 12 
S-6 s?4+4 9249 


Formula 16. Let 1 be a nonnegative integer and a € R. Verify the following 
Laplace transform formula: 


Power-Exponential Functions 


! 
Lit"e"}(s) = Care fors >a. 


V Verification. Notice that 


Lf t"et"\ (s) = / ete" dt = | eo S—t" dt = £{t"} (9 —a). 
0 


0 


What this formula says is that the Laplace transform of the function t"e“’ evaluated 
at the point s is the same as the Laplace transform of the function t” evaluated at the 
point s — a. Since L {t"} (s) = n!/s"*!, we conclude 


' 
Lie" s) = ae fors >a. A 
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If the function ¢” in Formula 16 is replaced by an arbitrary input function f(t) 
with a Laplace transform F(s), then we obtain the following: 


Theorem 17. Suppose f has Laplace transform F(s). Then 


First Translation Principle 


Lie" f (t)} (s) = F(s —a) 


Proof. 
Lik FO} = [ ee” f(t) dt 


= [ e S49) Ft) dt 


0 
= Lif} (s—a) = F(s —a). Fs 


In words, this formula says that to compute the Laplace transform of the product 
of f(t) and e“, it is only necessary to take the Laplace transform of f(t) (namely, 
F(s)) and replace the variable s by s — a, where a is the coefficient of ¢ in the 
exponential multiplier. It is convenient to use the following notation: 


L fe" fO} (8) = F)Ivosa 


to indicate this substitution. 


Formula 18. Suppose a,b € R. Verify the Laplace transform formulas 


r s—a 
Lie ‘cos bt} (s) = (ae +e 
and 
ee Oa 
(s—a)?+ b? 


V Verification. From Example 14, we know that 


s . b 
L {cos bt} (s) = Pam and CL {sin bt}(s) = aR 
Replacing s by s — a in each of these formulas gives the result. A 


Example 19. Find the Laplace transform of 


Qe sin3t and e* cos V2t. 
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> Solution. Again we use linearity of the Laplace transform and the formulas 
derived above to get 


3 6 6 
£427 sin 3t} = 2 ~—{ = = , 
penne BF eB | eager Ds  e eo) 
Ss s—3 s—3 
£fe* cos V21\ = —e = = ; 
Cay Oe ie (s—3)?+2 s*—6s+4+11 < 


We now introduce another useful principle that can be used to compute some 
Laplace transforms. 


Theorem 20. Suppose f(t) is an input function and F(s) = L{f(t)}(s) is the 
transform function. Then 


Transform Derivative Principle 


£{-1fO}.0) = SFO). 


Proof. By definition, F(s) = f° e~*' f(t) dt, and thus, 


d Co 
F’'(s) = — e" f(t) dt 
ds 0 
red 
=f Se soar 
o ds 
Co 
=f eM Rnfoa = £L-1f0} 60. 
Interchanging the derivative and the integral can be justified. Oo 


Repeated application of the transform derivative principle gives 


Transform nth-Derivative Principle 


d” 
_ F(s). 


ILE" fO}() = > 


Example 21. Use the transform derivative principle to compute 


L£{t sint}(s). 
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> Solution. A direct application of the transform derivative principle gives 


Lit sint}(s) = —L{-t sint} 


= -5£ {sin t} (s) 


d 1 
~dss2 +1 
n 2s) 2s 
(52 + 12 (s2 +12" 


< 


Example 22. Compute the Laplace transform of t7e’ in two different ways: using 
the first translation principle and the transform derivative principle. 


> Solution. Using the first translation principle, we get 


2 
LiPo} (8) = £4} Vas2 = Gope 


Using the transform derivative principle, we get 


ioe 1 od -l — 2 
~ ds2s—2  ds(s—2)2 (s—2)3" 


Exires « 


Suppose f(t) is a function and 5 is a positive real number. The function g(t) = 
Ff (bt) is called the dilation of f by b. If the domain of f includes [0, co), then 


so does any dilation of f since b is positive. The following theorem describes the 
Laplace transform of a dilation. 


Theorem 23. Suppose f(t) is an input function and b is a positive real number. 
Then 


The Dilation Principle 


Liflbt))} (s) = FEAL} (s/b). 


Proof. This result follows from a change in variable in the definition of the Laplace 
transform: 


Lif (bt)} (s) = / eo f (bt) dt 


=| e 6/4)" £(r) dr 
0 b 


1 


= ZF {FO} (6/6). 
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Table 2.2 Basic Laplace transform formulas (We are assuming n is a 
nonnegative integer and a and b are real) 


f(t) —_— F(s) = LL FO} (5) 
1 
1. 1 <> = 
s 
! 
2 i” << ae 
grt 
3 ew <> : 
s—a 
4. thet! < > ni 
(s —a)"+1 
5. cos bt <-> oR 
b 
6. sin bt <-> 24m 
a s—a 
7. e” cos bt << Goa th 
. b 
8. e”' sin bt — Goat 


Table 2.3 Basic Laplace transform principles 


Linearity Lf{af(t) + bg(t)} = aL {f}+ dL {g} 
Input derivative principles L{f’} (s) = sL{f(} — FO) 

LIES" ()} (5) = PLL F(t} — sf) — f’O) 
First translation principle Life" f()} = F(s —a) 


d 
Transform derivative principle L{—tf(t)}(s) = ae F(s) 
s 


The dilation principle L{f(bt)}(s) = xe {f(1)} (s/d). 


To get the second line, we made the change of variable t = r/b. Since b > 0, the 
limits of integration remain unchanged. Oo 


Example 24. The formula £ {sat} (s) = cot !(s) will be derived later (in 
Sect. 5.4). Assuming this formula for now, determine £ {sn2t} (s). 


> Solution. By linearity and the dilation principle, we have 


c =| ‘p= bc} | (s) 


II 
> 
|e 
a 
—_— 
a. 
5 
~ 
—— 


st>s/b 


= cot |(s) Liesn = cot !(s/b). « 


We now summarize in Table 2.2 the basic Laplace transform formulas and, in 
Table 2.3, the basic Laplace transform principles we have thus far derived. The 
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student should learn these well as they will be used frequently throughout the text 
and exercises. With the use of these tables, we can find the Laplace transform of 
many functions. As we continue, several new formulas will be derived. Appendix C 
has a complete list of Laplace transform formulas and Laplace transform principles 
that we derive. 
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Exercises 


1-4. Compute the Laplace transform of each function given below directly from 
the integral definition given in (1). 


1. 3t+1 

2. 5t — 9e! 
3. ec —3e7% 
4. te* 


5-18. Use Table 2.2 and linearity to find the Laplace transform of each given 
function. 


5. 5e! 
6. 3e°” — 723 
7.0? —5t+4 


8. 2 4+04+7¢41 

9. ec 4 Tte* 

10. t7e* 

11. cos2t + sin 2t 

12. e'(t — cos 4t) 
3..¢e"/ 

14. e"/ cos V6t 

15. (t +e)? 

16. 5cos 3t — 3 sin3t + 4 
14 

et 

18. e* (8 cos2t + 11 sin2t) 


17. 


19-23. Use the transform derivative principle to compute the Laplace transform of 
the following functions. 


19. te* 

20. t cos 3t 

21. t* sin2t 

22. te‘ cost ‘ 

23. tf(t) given that F(s) = L{f}(s) =In (=) 
set] 


24-25. Use the dilation principle to find the Laplace transform of each function. 
The given Laplace transforms will be established later. 


l—cos 5t. ,: l—cost\ — 1 2 
24, —S= ; given L { : i 4n(355) 


25. Ei(6t); given £ {Ei(r)} = “9 
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26-31. Use trigonometric or hyperbolic identities to compute the Laplace transform 
of the following functions. 


26. cos? bt (Hint: cos? @ = 5(1 + cos 26)) 

27. sin” bt 

28. sin bt cos bt 

29. sinat cos bt 

30. coshbt (Recall that cosh bt = (e% + e7')/2.) 
31. sinhbt (Recall that sinh bt = (e” — e~?")/2.) 


32-34. Use one of the input derivative formulas to compute the Laplace transform 
of the following functions. 


32.6% 

33. sinh bt 

34. coshbt 

35. Use the input derivative formula to derive the Laplace transform formula 


L {fo flu) du = F(s)/s. Hint: Let g(t) = [) f(u) du and note that g’(t) = 
f(t). Now apply the input derivative formula to g(f). 


36-41. Functions of Exponential Type: Verify the following claims. 


36. Suppose f is of exponential type of order a and b > a. Show f is of 
exponential type of order b. 

37. Show that the product of two functions of exponential type is of exponential 
type. 

38. Show that the definition given for a function of exponential type is equivalent 
to the following: A continuous function f on [0, co) is of exponential type of 
order a if there are constants K > 0 and N > 0 such that | f(t)| < Ke for all 
t => N (i.e., we do not need to require that N = 0). 

39. Show that the function y(t) = e” is not of exponential type. 

40. Verify that the function f(t) = e’ does not have a Laplace transform. That 
is, show that the improper integral that defines F(s) does not converge for any 
value of s. 

41. Let y(t) = sin(e"’). Why is y(t) of exponential type? Compute y’(t) and 
show that it is not of exponential type. Nevertheless, show that y’(t) has a 
Laplace transform. The moral: The derivative of a function of exponential type 
is not necessarily of exponential type, and there are functions that are not of 
exponential type that have a Laplace transform. 

42. Recall from the discussion for Formula 12 that the gamma function is defined 
by the improper integral 


r(p) = [ xP-le-* dx, (B > 0). 


2.2, 


43. 


44. 
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(a) Show that (1) = 1. 

(b) Show that I” satisfies the recursion formula (6B + 1) = BI'(B). 
(Hint: Integrate by parts.) 

(c) Show that ’(n + 1) = n! when x is a nonnegative integer. 


Show that />° eo dx = /n/2. 
(Hint: Let I be the integral and note that 


5 lee) 2 lee) 2 lee) lee) = 
I= e * dx e” dy)= e TY) dxdy. 
0 0 0 Jo 


Then evaluate the integral using polar coordinates.) 
Use the integral from Exercise 43 to show that I" (3) = ./z. Then compute 
each of the following: 


@rG) OG) OL} @L{H"}. 
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2.3 Partial Fractions: A Recursive Algorithm 
for Linear Terms 


A careful look at Table 2.2 reveals that the Laplace transform of each function we 
considered is a rational function. Laplace inversion, which is discussed in Sect. 2.5, 
will involve writing rational functions as sums of those simpler ones found in the 
table. 

All students of calculus should be familiar with the technique of obtaining the 
partial fraction decomposition of a rational function. Briefly, a given proper rational 
function’ p(s)/q(s) is a sum of partial fractions of the form 


Aj Bus + Cy 
—_+— and ————__., 
(s—r)/ (s2? ++cs + d)* 


where A;, By, and Cx are constants. The partial fractions are determined by the 
linear factors, s — r, and the irreducible quadratic factors, s? + cs +d, of the 
denominator q(s), where the powers j and k occur up to the multiplicity of the 
factors. After finding a common denominator and equating the numerators, we 
obtain a system of linear equations to solve for the undetermined coefficients 
A;, By, Cx. Notice that the degree of the denominator determines the number of 
coefficients that are involved in the form of the partial fraction decomposition. Even 
when the degree is relatively small, this process can be very tedious and prone to 
simple numerical mistakes. 

Our purpose in this section and the next is to provide an alternate algorithm for 
obtaining the partial fraction decomposition of a rational function. This algorithm 
has the advantage that it is constructive (assuming the factorization of the denom- 
inator), recursive (meaning that only one coefficient at a time is determined), and 
self-checking. This recursive method for determining partial fractions should be 
well practiced by the student. It is the method we will use throughout the text and is 
an essential technique in solving nonhomogeneous differential equations discussed 
in Sect. 3.5. You may wish to review Appendix A.2 where notation and results about 
polynomials and rational functions are given. 

In this section, we will discuss the algorithm in the linear case, that is, when the 
denominator has a linear term as a factor. In Sect. 2.4, we discuss the case where the 
denominator has an irreducible quadratic factor. 


Theorem 1 (Linear Partial Fraction Recursion). Suppose a proper rational 


function can be written in the form 


Pols) 
(s—r)"q(s) 


3A rational function is the quotient of two polynomials. A rational function is proper if the degree 
of the numerator is less than the degree of the denominator. 


130 2 The Laplace Transform 


and q(r) # 0. Then there is a unique number A, and a unique polynomial p,(Ss) 
such that 


Pols) AL Pils) 


: 1 
Cre) Gn * GN) a 
The number A, and the polynomial p,(s) are given by 
&-= pols)! _ pol) joe Pols) — Aig(s) (2) 
G(s) |s=r (7) sr 


Proof. After finding a common denominator in (1) and equating numerators, we 
get the polynomial equation po(s) = Aig(s) + (s —r)pi(s). Evaluating at s = r 


gives po(r) = Aiq(r), and hence A; = - . Now that A; is determined, we have 


Po(s) — Aig(s) = (s —r)pi(s), and hence p(s) = Pols Aig) Oo 


= 


Notice that in the calculation of p1, it is necessary that po(s) — Aiq(s) have a 
factor of s — r. If such a factorization does not occur when working an example, 
then an error has been made. This is what is meant when we stated above that this 
recursive method is self-checking. In practice, we frequently factor po(s) — Aigq(s) 
and delete the s — r factor. However, for large degree polynomials, it may be best to 
use the division algorithm for polynomials or synthetic division. 

An application of Theorem | produces two items: 


¢ The partial fraction of the form 


A, 
(s—r)" 


e A remainder term of the form 


pls) 
(s —r)"~"q(s) 


such that the original rational function po(s)/(s — r)"q(s) is the sum of these two 
pieces. We can now repeat the process on the new rational function p:(s)/((s — 
r)"—!q(s)), where the multiplicity of (s — r) in the denominator has been reduced 
by 1, and continue in this manner until we have removed completely (s — r) as a 
factor of the denominator. In this manner, we produce a sequence, 


Aj An 
(s—ryt (sr) 


which we will refer to as the (s — r)-chain for po(s)/((s — r)"q(s)). The number 
of terms, n, is referred to as the length of the chain. The chain table below 
summarizes the data obtained. 
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The (s — r)-chain 


Po(s) A, 
(s —r)"q(s) (s—r)" 
Pils) Ay 


(s—r)""(s)q(s) Car 


Pn-1(8) An 
(s —r)q(s) (s—r) 
Pals) 
q(s) 


Notice that the partial fractions are placed in the second column while the remainder 
terms are placed in the first column under the previous remainder term. This form is 
conducive to the recursion algorithm. From the table, we get 


Pols) A\ An Pui) 


C—n'qs) Gon" GN as) 


By factoring another linear term out of g(s), the process can be repeated through all 
linear factors of g(s). In the examples that follow, we will organize one step of the 
recursion process as follows: 


Partial Fraction Recursion Algorithm 
by a Linear Term 


pols) AL Pils) 
Gang) Gan \ C=) 


Pols) 
q(s) 


where A; = 


s=r 


1 
and pi(s) = 5p Pals) — Aig(s)) =O 
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The curved arrows indicate where the results of calculations are inserted. First, Aj 
is calculated and inserted in two places: in the (s — r)-chain and in the calculation 
for p(s). Afterward, p;(s) is calculated and the result inserted in the numerator of 
the remainder term. Now the process is repeated on p,(s)/((s—r)"—'q(s)) until the 
(s — r)-chain is completed. 

Consider the following examples. 


Example 2. Find the partial fraction decomposition for 
s—2 
(s —3)°(s — 4) 


> Solution. We will first compute the (s — 3) -chain. According to Theorem 1, we 
can write 


s—2 pits) — 
(s—3)2(s—4) os (s — 3)(s — 4) 
where A, = sii = 
s=3 
and p,(s) = 365 —2-(- | —4))= 502s — 6) =2. 
We thus get 
s-2 = 2 
6-3°6-4) G-3P * 36-4) 


We now repeat the recursion algorithm on the remainder term 
to get 


2 
(s—3)(s—4) 


2 Pals) 
(s—3)(s—4) 
where A; = 
and p2(s) = —- = as 005-6) =2. 
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Putting these calculations together gives the (s — 3)-chain 


The (s — 3) -chain 
s—2 —1 
(s — 3)?(s — 4) (s — 3)? 
2 —2 
(s—3)(s—4) (s — 3) 
2 
s—4 


The (s — 4)-chain has length one and is given as the remainder entry in the (s — 3)- 
chain; thus 


ee 2 2 
€=96=-4 G@=32 -G=) sa 


A more substantial example is given next. The partial fraction recursion algo- 
rithm remains exactly the same so we will dispense with the curved arrows. 


Example 3. Find the partial fraction decomposition for 


16s 
@+ 1*(s=1)" 


Remark 4. Before we begin with the solution, we remark that the traditional 
method for computing the partial fraction decomposition introduces the equation 


16s Ay Ay A; A4 As 


Cl pG=ik Gtis’ @Lie sai woe a4 


and, after finding a common denominator, requires the simultaneous solution to a 
system of five equations in five unknowns, a doable task but one prone to simple 
algebraic errors. 


> Solution. We will first compute the (s + 1) -chain. According to Theorem 1, we 
can write 
16s — A " Pils) 
(+I36—-D2 +D3 | + IRO— 1?’ 


16 16 
where A, = ed = = 4 
(s — 1)? 4 


s=—l 
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eee ls — (-4)(s — 1)?) 


4 2 
= so+2s+1)=4(s4 1). 
F i! ) ( ) 


+1 


A(s+1) 
We now repeat the recursion step on the remainder term Gt 2G—17 10 get 


4(s + 1) Ay p2(s) 


GhivG=D2 ori -Grnasn. 


where a BOE) ee, 
(s = 1)? s=—l1 4 
and po(s) = (Ks + 1)—(0)(s — 1)*) = 4. 


Notice here that we could have canceled the (s+ 1) term at the beginning and arrived 
immediately at yeep: Then no partial fraction with (s + 1)? in the denominator 
would occur. We chose though to continue the recursion step to show the process. 
. . 4 
The recursion process is now repeated on Gtpe=? to get 


4 A3 p3(Ss) 


(st1)\(s—12 stil (s—1)?’ 


4 4 
where A3 = ——— =—-_=|]| 
(s — 1)? 4 


s=—l 


afd = 4 (1)(s — 1)2) 


pa | 2 
= —_(s? —25—3) = 
or ) 


+ (s + 1)(s — 3) = -(s — 3). 


S 


Putting these calculations together gives the (s + 1) -chain 


The (s + 1) -chain 
16 —4 
(s + 1)3(s — 1)? (s + 1)3 
A(s + 1) 0 
(s + 1)2(s — 1)? (s + 1)? 
4 1 
(s + 1)(s — 1)? (s+ 1) 
—(s — 3) 
GD; 
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—(s—3) 


We now compute the (s — 1) -chain for the remainder Go? 


It is implicit that 


q(s) = 1. 
—(s—3) As ti pa(s) 
(s—1)2  (s—1)? s-1’ 
where Ay = as a 3) =2 


s=1 


1 
and p4(s) = 6 —3)-(2))= at +1)=-1. 


The (s — 1) -chain is thus 


The (s — 1) -chain 


—(s — 3) 2 
(s — 1)? (s — 1)? 
=] 


(s—1) 


We now have 
—(s—3 2 —l 
( ) = + 9 
(s — 1)? (s—1)? s—-1 


and putting this chain together with the s + 1 -chain gives 


SE I a 
(s+13(s—1?2 (s+)D3 > (412) st+1 (1)? s-1 


< 


Product of Distinct Linear Factors 


Let p(s)/q(s) be a proper rational function. Suppose q(s) is the product of distinct 
linear factors, that is, 


q(s) = (8-11) +++ (s— Tn), 
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where r1,... 7, are distinct scalars. Then each chain has length one and the partial 
fraction decomposition has the form 


p(s) Ay — An 
i) s=1 GEN) 


The scalar A; is the first and only entry in the (s — r;) -chain. Thus, 


—_ PO) _ PM) 
" ai(s) ay GD): 


where qi(s) = q(s)/(s — r;) is the polynomial obtained from qg(s) by factoring 
out (s — 7;). If we do this for each i = 1,...,n, it is unnecessary to calculate any 
remainder terms. 


Example 5. Find the partial fraction decomposition of 


—4s+ 14 
(s — 1)(s + 4)(s — 2) 


> Solution. The denominator q(s) = (s — 1)(s + 4)(s — 2) is a product of distinct 
linear factors. Each partial fraction is determined as follows: 


A —4s + 14 10 
e For 1= = — —2 
s- (s+ 4)(s—2)],-, —-5 
—4 14 
e¢ For : Ap= ee east = ae =1 
s+4 (s—1)(s—2)|,_, 30 
A —4 14 
° For —: A3= uae = es 1 
s—2 (s—l)(s+4],. 6 
The partial fraction decomposition is thus 
—4s + 14 _ = if 1 4 1 a 
(s—1)(s+4)(s-—2) s—-1 s+4 s—2 


Linear Partial Fractions and the Laplace Transform Method 


In the example, notice how linear partial fraction recursion facilitates the Laplace 
transform method. 


2.3. Partial Fractions: A Recursive Algorithm for Linear Terms 137 


Example 6. Use the Laplace transform method to solve the following differential 
equation: 


y" + 3y' + 2y =e", (3) 
with initial conditions y(0) = | and y’(0) = 3. 
> Solution. We will use the Laplace transform to turn this differential equation in 


y into an algebraic equation in Y(s) = £{y(t)}. Apply the Laplace transform to 
both sides. For the left-hand side, we get 


L fy” + 3y’ + 2y} = L {y"} + 3L {y’} + 2L {y} 
= s°Y(s) — sy(0) — y'(O) + 3(s¥(s) — y(0)) + 2¥(s) 
= (s? +38 +2)¥(s)-—s—6. 


The first line uses the linearity of the Laplace transform, the second line uses the 
first and second input derivative principles, and the third line uses the given initial 
conditions and then simplifies the result. Since £ {e~} = 1/(s + 1), we get the 
algebraic equation 


1 
2 
+ 35+ 2)Y —s—6 = —.,, 
(s S )Y(s) S wai 


from which it is easy to solve for Y(s). Since s* + 3s +2 = (s + 1)(s 4+ 2), 
we get 
s+6 1 


TO) GD) Ge GD 


We are now left with the task of finding an input function whose Laplace transform 
is Y(s). To do this, we first compute the partial fraction decomposition of each term. 
The first term Ge has denominator which is a product of two distinct linear 
terms. Each partial fraction is determined as follows: 


6 5 
¢ For >: AL= ms =-—=5 
s+1 Se 2s ectags (A 
4 
¢ For ; Aasee =—_=-4 
s+2 st1j_, -l 
The partial fraction decomposition is thus 
s+6 5 4 


(stI(s+2) stl s+2’ 
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For the second term we compute the (s + 1)-chain 


1 
(sF1)2(s+2)’ 


The (s + 1) -chain 
1 1 
(s + 1)?(s + 2) G1}? 
—1 —1 
(s + 1)(s + 2) s+1 
1 
s+2 
from which we get 
1 1 1 1 


— —_ + 2 
(s+12(s+2) (s+1?% s+l s42 
It follows that 
3 1 
stl s4+2  (s+1)° 


Now we can determine the input function y(t) directly from the basic Laplace 
transform table, Table 2.2. We get 


Y(s) = 


y(t) = 4e! —3e°7 + te. 


This is the solution to (3). < 
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Exercises 


1-11. For each exercise below, compute the chain table through the indicated linear 
term. 


5 10 
i (= 1) 
(s — 1)(s + 4) 
) 10s —2 (s 2) 
. >; (5- 
(s + 1)(s — 2) 
3 : (s—5) 
. >; Sd - 
(s + 2)(s — 5) 
5s +9 
Ay See ae 
(s — 1)(s + 3) 
35+ 1 
5, ———.—_;; -1 
G=hpesp “» 
3s -s +6 
6. ———_.—__; (s+l 
(s + 1)(s? + 4) ( ) 
se +s—3 
7. ———; 3 
(s + 3)3 ee) 
5s? — 3s + 10 
8. ——__——_.]|; (s+2 
(s + 1)(s + 2)? ( ) 
Ss 
9, ——_____—__; 1 
Goya Yr” 
10 16s ( 1) 
. oo OU 
= 1h@=3) 
i : (s—5) 
. >: 0 6- 
(s — 5)°(s — 6) 
12-32. Find the partial fraction decomposition of each proper rational function. 
5s +9 
" (s —1)(s +3) 
13. ao 
s*?—25s—15 
1 
14. ————_ 
s*—35 +42 
5s —2 


"524 25 — 35 
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16. 


17. 


18. 


19. 


20. 


21. 


22. 


23; 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


31. 


32: 


35+ 1 
sets 
2s +11 
s*—6s—7 
287 +7 
(s — 1)(s — 2)(s — 3) 
P+st] 
(s — 1)(s? + 3s — 10) 
2 


s 
(sl)? 
7 
(s + 4)4 
s 
(s — 3)8 
se +s—3 
(s + 3)3 
5s? —3s + 10 
(s + 1)(s + 2)? 
s?—6s+7 
81 
s3(s + 9) 
s 
(s + 2)2(s + 1)? 


g2 


(s + 2)2(s + 1)? 
8s 


(s — 1)(s — 2)(s — 3)3 
25 
s2(s — 5)(s + 1) 
s 
27 6= 3) 
16s 
(s=1)7(6=3)* 
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33-38. Use the Laplace transform method to solve the following differential 
equations. (Give both Y(s) and y(t).) 

33. y” + 2y’+y=9e", y(0) =0, y’(0) =0 

34, y” + 3y’4+2y = 12e%, y(0)=1,y’/0) =-1 

35. y” —4y’—5y = 150t, y(0)=—1, y'(0) =1 

36. y’ +4y’+4y =4cos2t, y(0)=0, y’(0)=1 

37. y’ —3y'+2y=4, y(0O) =2, y’(0) =3 

38. y’—3y'+2y=e', y(0) = -3, y’(0) =0 
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2.4 Partial Fractions: A Recursive Algorithm for Irreducible 
Quadratics 


We continue the discussion of Sect.2.3. Here we consider the case where a real 
rational function has a denominator with irreducible quadratic factors. 


Theorem 1 (Quadratic Partial Fraction Recursion). Suppose a real proper ra- 


tional function can be written in the form 


Po(s) 
(s? +cs + d)"q(s)’ 


where s* + cs + d is an irreducible quadratic that is factored completely out of 
q(s). Then there is a unique linear term B,s + C, and a unique polynomial p(s) 
such that 


Pols) —  Bist+Cy 4. Pils) (1) 
(s2+cs+d)q(s) (st? t+estd)y — (s2?+c5+d)"-lq(s)’ 


Ifa + ib is a complex root of s* + cs +d, then B,s + C, and the polynomial p,(s) 
are given by 


Po(s) minis Pols) — (Bis + Cats) 


Bis +Ci\._,4,, = 
8+ Cilseatoi = G69 er sttest+d 


(2) 


Proof. After finding a common denominator in (1) and equating numerators, we get 
the polynomial equation 


po(s) = (Bis + Ci)q(s) + (s* + cs + d) pi(s). (3) 


Evaluating at s = a + ib gives po(a + ib) = (Bi(a + ib) + C))(q(a + 1b)), and 
hence, 
Po(a + ib) 


B +ib)+C, = 
ee) : q(a + ib) 


(4) 


Equating the real and imaginary parts of both sides of (4) gives the equations 


_ | 
Bia + C, = Re (MEO ; 
Bib= —_—_ ]. 

i” Im (Se 


Since b # 0 because the quadratic s* + cs + d has no real roots, these equations 
can be solved for B; and C;, so both B, and C, are determined by (4). Now solving 
for p.(s) in (3) gives 
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Pols) — (Bis + Ci)q(s) 
sretes+d : 


Pils) = 


An application of Theorem | produces two items: 


e The partial fraction of the form 


Buys +C; 
(SS? es + a)" 


e A remainder term of the form 


Pils) 
(s? + cs + d)"—!q(s) 


such that the original rational function po(s)/(s* + as + b)"q(s) is the sum of these 
two pieces. We can now repeat the process in the same way as the linear case. 

The result is called the (s* + cs + d)-chain for the rational function po(s)/(s?+ 
cs + d)"q(s). The table below summarizes the data obtained. 


The (s* +. cs + d)-chain 


Po(s) Bis +C, 
(s? +cs + d)"q(s) (s?+es +d)" 
Pils) Boys + Cy 


(s? + cs + d)""'q(s) (s? +cs + d)'-} 


Pn-1(S) Bis + Ch 
(s? ++cs +d) q(s) (s? ++cs +d) 
PrlS) 
q(s) 


From this table, we can immediately read off the following decomposition: 


Pols) Bis + Cy ByS + Cy Pn(S) 


(s2es+d)q(s) (2 +est+dy | (2 +est+d) q(s)’ 


In the examples that follow, we will organize one step of the recursion algorithm 
as follows: 
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Partial Fraction Recursion Algorithm 
by a Quadratic Term 


Pols) Bus +C, 


(s?+es+d)"q(s)  (s?+es+d)" d)"~'q(s) 
where Bis + Ci|,-g45) = Pols) => B, =UOandC,; =O 
q(s) s=at+bi 
and pi(s) = perry CL — (Bis + Ci)q(s)) =O 


As in the linear case, the curved arrows indicate where the results of calculations 

are inserted. First, B, and C, are calculated and inserted in two places: in the (s? + 

cs+d)-chain and in the calculation for p(s). Afterward, p;(s) is calculated and the 

result inserted in the numerator of the remainder term. Now the process is repeated 

on pi(s)/((s? + cs + d)"—!q(s)) until the (s? + cs + d)-chain is completed. 
Here are some examples of this process in action. 


Example 2. Find the partial fraction decomposition for 


5s 
(s2 + 4)(s +1) 


> Solution. We have a choice of computing the linear chain through s + 1 or 
the quadratic chain through s? + 4. It is usually easier to compute linear chains. 
However, to illustrate the recursive algorithm for the quadratic case, we will 
compute the (s + 4)-chain. The roots of s* + 4 are s = +2i. We need only focus 
on one root and we will choose s = 2i. 

According to Theorem |, we can write 


5s Bis+C; — pi(s) 
(s?+4)(s+1) (s2+4) 0 st] 


5s 10: 
s+ 1), 2i+1 
(10i)(—2i+ 1) _ 20 + 10i 
(i+1)(-2i+1) 5 


=> B, =landC, =4 


where B,(2i)+C, = 


= 442i 
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1 
and pils) => ag = (s + A)(s + 1)) 
1 2 
= ——(-s* —4)=-1. 
s+ 4! ay 
It follows now that 
58 s+4 —l 


GLACE: GED at 


Note that in the above calculation, B, and C; are determined by comparing the 
real and imaginary parts of the complex numbers 2B,i + C,; = 2i + 4 so that the 
imaginary parts give 2B; = 2 so B, = 1 and the real parts give C, = 4. 


Example 3. Find the partial fraction decomposition for 


30s + 40 
(s2 + 1)2(s?2 + 2s + 2)" 


Remark 4. We remark that since the degree of the denominator is 6, the traditional 
method of determining the partial fraction decomposition would involve solving a 
system of six equations in six unknowns. 


> Solution. First observe that both factors in the denominator, s* + 1 and s* + 
2s +2 = (s + 1)? +1, are irreducible quadratics. We begin by determining the 
s? + 1 -chain. Note that s = i is a root of s? + 1. 
Applying the recursive algorithm gives 
30s + 40 Bis +Ci pils) 


= + ; 
(s2 + 1)?(s? + 2s + 2) (s? +1)? — (s? + 1)(s? + 25 4 2) 


40 i+ 40 
where Byi+C; = Bec = 301+ 
G2 2s 2) e4 1+ 2i 
40 + 30i)(1—2i) 100 —50i 
= a ee es ai 
(1 + 2i)(1 — 2i) 5 
=> BB, =-10 andC; = 20 
1 
and pi(s) = Tq 0s + 40 — (10s + 20)(s* + 2s + 2)) 
AY 
1 


ey (10s(s? + 1)) = 10s. 
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We now repeat the recursion algorithm on the remainder term 


10s 
(s2 + 1)(s2 + 2s + 2) 


10s a BED 4, = 5) 
(s?+1)(s?+2s4+2) (8241) (s2? +2542)’ 


10s 101 
(s?+25+2)|,-; 142i 
(10i)(1—2i) 204 103 


where Boi+C, = 


= - = =4+42i 
(+ 2i)(1 — 2i) 5 
> By =2andC, =4 
1 
and p(s) = > (10s — (2s + 4)(s” + 2s + 2)) 
se+1 
1 2 


We can now write down the (s? + 1)-chain. 


The (s? + 1)-chain 


30s + 40 ~10s + 20 
(s? + 1)?(s? + 25 + 2) (s? + 1)? 
10s 2s+4 
(s? + 1)(s? + 2s + 2) (s? + 1) 
—2(s + 4) 
(s2 + 2s + 2) 


Since the last remainder term is already a partial fraction, we obtain 


30s + 40 _—10s+ 20 2s+4 —25-—8 
(s? + 1)?(s? + 25 + 2) (s?4+1)?2 s?4+1 0 (8 +1241 
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Quadratic Partial Fractions and the Laplace Transform Method 


In the following example, notice how quadratic partial fraction recursion facilitates 
the Laplace transform method. 
Example 5. Use the Laplace transform method to solve 

y” + 4y = cos3t, (5) 
with initial conditions y(0) = 0 and y’(0) = 0. 
> Solution. Applying the Laplace transform to both sides of (5) and substituting 


the given initial conditions give 


(s? + 4)Y(s) = 


S 
s2 +9 
and thus 

Ss 


~ (52 4 4)(s2 4 9)’ 


Using quadratic partial fraction recursion, we obtain the (s? + 4)-chain 


Y(s) 


The (s? + 4)-chain 


Ss s/5 
(s? + 4)(s? + 9) se+4 
—s/5 
s2+9 


It follows from Table 2.2 that 
1 
y(t) = (cos 2t — cos3r). 


This is the solution to (5). < 
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Exercises 


1-6. For each exercise below, compute the chain table through the indicated 
irreducible quadratic term. 


1 
ee 
@+pery © +? 
2 a > (s2 4.2) 
"(g?  2)* (6? 3)" 
85 + 857 
Gee ae 
@rayusy “>? 
4s4 
45 ee 
@+oe+rHy © +9 
1 
S. ;(s? +25 +2 
@li SG ernas OTO 
55 —5 
6. 7 5 (s? + 25 +2) 


(s? + 2s + 2)?(s2 + 4s + 5) 


7-16. Find the decomposition of the given rational function into partial fractions 
over R. 


: s 
* (s2 + 1)(s — 3) 
8 4s 
 (s2 + 1)?(s + 1) 
: 9s? 
* (s? + 4)2(s? + 1) 
9s 
10. ——_-——_ 
(s? + 1)?(s? + 4) 
2 
11. 
(s? — 6s + 10)(s — 3) 
D 30 
* (s2—4s + 13)(s — 1) 
25 
13. 
(s? — 4s + 8)?(s — 1) 
14. 7 
(s2 + 6s + 10)?(s + 3)? 
15 stl 


(s? + 4s + 5)?(s? + 45 + 6)? 
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AY 
16. 
(SF + 5) + OP 


Hint: Let u = s?. 


17-20. Use the Laplace transform method to solve the following differential 
equations. (Give both Y(s) and y(t).) 

17. y’ + 4y’ + 4y = 4cos2r, y(0)=0, y’/(0) = 1 

18. y” + 6y’ + 9y = 50sint, y(0) =0, y’(0) =2 

19. y” + 4y =sin3t, y(0)=0, y’(0) =1 

20. y”+2y’+2y =2cost+sint, y(0)=0, y’(0)=0 
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2.5 Laplace Inversion 


In this section, we consider Laplace inversion and the kind of input functions that 
can arise when the transform function is a rational function. Given a transform 
function F'(s), we call an input function f(t) the inverse Laplace transform of 
F(s) if £{f(t)}(s) = F(s). We say the inverse Laplace transform because in 
most circumstances, it can be chosen uniquely. One such circumstance is when the 
input function is continuous. We state this fact as a theorem. For a proof of this 
result, see Appendix A.1 


Theorem 1. Suppose f(t) and f2(t) are continuous functions defined on [0, 00) 
with the same Laplace transform. Then f(t) = f2(t). 


It follows from this theorem that if a transform function has a continuous 
input function, then it can have only one such input function. In Chap. 6, we will 
consider some important classes of discontinuous input functions, but for now, we 
will assume that all input functions are continuous and we write £7! {F(s)} for 
the inverse Laplace transform of F. That is, £~' {F(s)} is the unique continuous 
function f(t) that has F(s) as its Laplace transform. Symbolically, 


Defining Property of the Inverse Laplace Transform 


LL F(s)} = fO) => LIfO} = FO). 


We can thus view £7! as an operation on transform functions F(s) that produces 
input functions f(t). Because of the defining property of the inverse Laplace 
transform, each formula for the Laplace transform has a corresponding formula for 
the inverse Laplace transform. 


Example 2. List the corresponding inverse Laplace transform formula for each 
formula in Table 2.2. 


> Solution. Each line of Table 2.4 corresponds to the same line in Table 2.2. < 


By identifying the parameters n, a, and b in specific functions F(s), it is possible to 
read off £7! {F(s)} = f(t) from Table 2.4 for some F(s). 


Example 3. Find the inverse Laplace transform of each of the following functions 
F(s): 
6 2 5 s—1 


lL = 2. —— 3. 4, —___ 
st (s + 3)3 gs? +25 (s—1)2+4 


> Solution. 


1. £-'{S} = 73 (n = 3 in Formula 2) 
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2. £7! |r} = t?e* (n = 2, a = —3 in Formula 4) 


s2?+25 


a got \zn} = sin 5t (b = 5 in Formula 6) 


4. cio} = e' cos 2t (a = 1, b = 2 in Formula 7) < 

It is also true that each Laplace transform principle recorded in Table 2.3 results 
in a corresponding principle for the inverse Laplace transform. We will single out 
the linearity principle and the first translation principle at this time. 


Theorem 4 (Linearity). The inverse Laplace transform is linear. In other words, if 
F(s) and G(s) are transform functions with continuous inverse Laplace transforms 
and a and b are constants, then 


Linearity of the Inverse Laplace Transform 


Lo! {aF(s) + bG(s)} = al {F(s)} + BDL" {G(s)} . 


Proof. Let f(t) = L7'{F(s)} and g(t) = L7!{G(s)}. Since the Laplace 
transform is linear by Theorem 5 of Sect. 2.2, we have 


Li(af(t) + bgt} = aL {f)} + DL {g(t)} = aF(s) + G(s). 
Since af(t) + bg(t) is continuous, it follows that 


Lo {aF(s) + bG(s)} = af(t) + bg(t) = aL" {F(s)} + DL" {G(s)}. 


Theorem 5. /f F(s) has a continuous inverse Laplace transform, then 


Inverse First Translation Principle 


LO LF(s —a)} =e" LF (s)} 


Proof. Let f(t) = £7' {F(s)}. Then the first translation principle (Theorem 17 of 
Sect. 2.2) gives 


L{e" f(t)} = F(s—a), 


and applying £7! to both sides of this equation gives 


LI {F(s—a)j} =e" f(t) =e" Lf F(s)}. Oo 
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Table 2.4 Basic inverse 


Laplace transform formulas i. ~! -| = 
(We are assuming 71 is a s 
nonnegative integer and a and 2 col ntl ” 
b are real) grt 
3. ££ : =e" 
S—a 
—1 n! = feat 
4. £ {oan aie 
5. £7! . =cosbt 
s? + b? 
b 
6 =) a = sinbt 
S 
7. £7} ioe = e“ cos bt 
s—a)j+ 
—1 b — elt a 
8 L ( yre e” sin bt 
s—a)j?+ 


Suppose p(s)/q(s) is a proper rational function. Its partial fraction decomposi- 
tion is a linear combination of the simple (real) rational functions, by which we 
mean rational functions of the form 


1 b d s-—a 
(ak (Gat bar (say? + bY 


(1) 


where a, b are real, b > 0, and k is a positive integer. The linearity of the inverse 
Laplace transform implies that Laplace inversion of rational functions reduces to 
finding the inverse Laplace transform of the three simple rational functions given 
above. The inverse Laplace transforms of the first of these simple rational functions 
can be read off directly from Table 2.4, while the last two can be determined from 
this table if k = 1. To illustrate, consider the following example. 


Example 6. Suppose 
5s 


LS) = eae aly 


Find £7! {F(s)}. 


> Solution. Since F(s) does not appear in Table 2.4 (or the equivalent Table 2.2), 
the inverse Laplace transform is not immediately evident. However, using the 
recursive partial fraction method we found in Example 2 of Sect. 2.4 that 


5s ees 1 
(P+4)(s+1) (?4+4) st] 
Ss 2 1 


” 42 222 
peg 2? * sea 2 gael 
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By linearity of the inverse Laplace transform and perusal of Table 2.4, it is now 
evident that 


5. 
cto —| =cos2t + 2sin2r—e™. > 
Ss Ss 


When irreducible quadratics appear in the denominator, their inversion is best 
handled by completing the square and using the first translation principle as 
illustrated in the following example. 

Example 7. Find the inverse Laplace transform of each rational function 
4s —8 2; 
.>—— 2. 
s? + 6 + 25 s?—4s+7 


> Solution. In each case, the denominator is an irreducible quadratic. We will 
complete the square and use the translation principle. 
1. Completing the square of the denominator gives 

+ 6s+25=5*+654+9425-9=(54+ 3744. 


In order to apply the first translation principle with a = —3, the numerator must 
also be rewritten with s translated. Thus, 4s—8 = 4(s+3-—3)—8 = 4(s+3)—20. 
We now get 


iy 4s —8 ee 4(s +3) —20 
s? + 65 + 25 (s +3)? +4 


_ up eo 70 


g2 + 42 


=e *(4cos4t —5sin4r). 


Notice how linearity of Laplace inversion is used here. 
2. Completing the square of the denominator gives 
<2 
se —4s4+7=5s*-454+443= (8-27 +3. 


We now get 


a 
s*—4s4+7 (oo 4a 
2 


= ec} 
4/3 
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V3 

2 

s24+ 3 


2 ot 
= —e” sin V3t. > | 
J3 


=i 


In the examples above, the first translation principle reduces the calculation of 
the inverse Laplace transform of a simple rational function involving irreducible 
quadratics with a translated s variable to one without a translation. More generally, 
the inverse first translation principle gives 


b b 
a = eet ae 
= + b2 k 24 p2 k 
((s — a) ) (s ) (2) 


—1 sS—a — gat r-l 5 
loam ae" ogee 


Table 2.4 does not contain the inverse Laplace transforms of the functions on the 
right unless AK = 1. Unfortunately, explicit formulas for these inverse Laplace 
transforms are not very simple for a general k > 1. There is however a recursive 
method for computing these inverse Laplace transform formulas which we now 
present. This method, which we call a reduction of order formula, may remind you 
of reduction formulas in calculus for integrating powers of trigonometric functions 
by expressing an integral of an nth power in terms of integrals of lower order powers. 


Proposition 8 (Reduction of Order formulas). /fb 4 0 is a real number and 
k > 1 is a positive integer, then 


co! 1 _ oct co S got 1 1 
(s? + b2)k+1 ~~ Iep2 (s2 + b2)k Akb2 (s2 a b2)k ; 


af s — tay 1 
CN amr a era 


Proof. Let f(t) = L7! \aaimr- 
(Theorem 20 of Sect. 2.2) applies to give 


Then the transform derivative principle 


d d 1 


= 2ks 
2 (s2 4 b2yk+1" 
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Now divide by 2k and take the inverse Laplace transform of both sides to get 


s t t 1 
‘a = th=—L! : 
(s2 + b2)k+1 2k fO 2k (s? + aa 
which is the second of the required formulas. 


The first formula is done similarly. Let g(t) = £7! { i 


Ss 
GbE \ . Then 


Litg(t)s 


d Cc _ d S 
—< (tei) = -— (asa) 
= (s? + b?)* = 2ks? (57 + b7)* 


(s2 + b2)2k 
_ 287k —(s? +57) — (2k — 1)(s? + b*) — 2kb? 
= (s2 = b2)k+1 _ (s2 + b2)k+1 
2k —1 2kb? 


~ (G24 b2% (52-4 B21 


Divide by 2kb?, solve for the second term in the last line, and apply the inverse 
Laplace transform to get 


o 1 
—t (2k —-1) ,_, 1 
28) + ee feesesa 


=. co S de (2k —1) ,_, 1 
~~ 2kb2 (s2 + b2)k 2kb? (s2 + b2)Ff 
which is the first formula. oO 


These equations are examples of one step recursion relations involving a pair of 
functions, both of which depend on a positive integer k. The kth formula for both 
families implies the (k + 1)*. Since we already know the formulas for 


_ 1 _ s 
Vasa ™ leper: i 


when k = 1, the reduction formulas give the formulas for the case k = 2, which, in 
turn, allow one to calculate the formulas for k = 3, etc. With a little work, we can 
calculate these inverse Laplace transforms for any k > 1. 

To see how to use these formulas, we will evaluate the inverse Laplace transforms 
in (3) fork = 2. 
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Formula 9. Use the formulas derived above to verify the following formulas: 


1 1 ; 
co Coe a} = 553 (—bt cos bt + sin bt), 


-1 s = Eg 
L =a, sin bt. 


V Verification. Here we use the reduction of order formulas for k = | to get 


1 —t S 1 1 
-1 — —1 —1 
. | | ap ara + ape ‘arm 


—t 1 
= —~ cosbt + —~ sinbt 


2b? 2b3 
1 : 
= apa Pt cos bt + sin bt), 
-1 s tay 1 <P is 
and CL | rams} = 56 tape} = pp sinee A 


Using the calculations just done and applying the reduction formulas for k = 2 
will then give the inverse Laplace transforms of (3) for k = 3. The process can then 
be continued to get formulas for higher values of k. In Table 2.5, we provide the 
inverse Laplace transform for the powers k = 1, ..., 4. You will be asked to verify 
them in the exercises. In Chap. 7, we will derive a closed formula for each value k. 

By writing 


cs+d KY 1 


(s2 + b2)k+1 “(2 + b2)k+1 +4 (s2 + b2)k+1’ 


the two formulas in Proposition 8 can be combined using linearity to give a single 
formula: 


Corollary 10. Let b, c, and d be real numbers and assume b # 0. Ifk > lisa 
positive integer, then 


4 cst+d _ it gy | SOS ek” 2k-1._, d 
(s2 + b2)kt1f 2k? (s? + b?)* 2kb? (s2 + b2)k f° 


As an application of this formula, we note the following result that expresses the 


form of £7! {ak} in terms of polynomials, sines, and cosines. 
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Table 2.5 Inversion formulas involving irreducible quadratics 


clare ot 

(s? + b?)# G+ by 
sin bt eos —— 
> (sin bt — bt cos bt) $s eo 
gts ((3 — (bt)?) sin bt — 3bt cos br) x ao 
gas ((15 — 6(b1)?) sin bt — (15bt — (bt)*) cos bt) <> —_ 
cH aR pa 

(s2 + b2)k Ga BD 

Ss 

cos bt Ss mm 
sp bt sin bt ey am 
apt (bt sin bt — (bt)* cos bt) gee =m 
ahs ((3bt — (bt)*) sin bt — 3(bt)? cos br) a a 


Corollary 11. Let b, c, and d be real numbers and assume b # 0. Ifk > lisa 
positive integer, then there are polynomials p\(t) and p2(t) of degree at most k — 1 
such that 
+f estd : 
> = pi (t) sinbt + p(t) cos dt. 4 
| Era = POsinde + pale) «) 


Proof. We prove this by induction. If k = 1, this is certainly true since 


cae 


a sin bt + ccosbt, 


g2 + b2 
and thus, pi(t) = d/b and p2(t) = c are constants and hence polynomials of 
degree 0 = 1 — 1. Now suppose for our induction hypothesis that k > 1 and that 
(4) is true for k. We need to show that this implies that it is also true for k + 1. By 
this assumption, we can find polynomials pi(t), po(t), qi(t), and q2(t) of degree at 
most & — 1 so that 


—ds + cb? 
=a a = p(t) sin bt + po(t) cos bt 


and = qi(t) sin bt + qo(t) cos dt. 


, d 
. lam 
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By Corollary 10, 


4 est+d _ t 4 §-ds+cb? 2k-1_, d 
(s2 + b2)k+1§  2kb? (s? + b2)k Akb2 (s? + b2)k 


t 
2k b? 


II 


(pi(t) sin bt + p(t) cos bt) 


2k —1 
+ 


pr (MO sin bt + qx(t) cos bt) 


= P(t) sinbt + P(t) cos dt, 


where 


t 2k —1 t 2k —1 
Pi(t)= pO a aEpr 1) and P2(t)= 5Ep2 2) + appr 220): 


Observe that P,(t) and P(t) are obtained from the polynomials p;(t), gi(t) by 
multiplying by a term of degree at most 1. Hence, these are polynomials whose 
degrees are at most k, since the p;(t), g;(t) have degree at most k—1. This completes 
the induction argument. Oo 


It follows from the discussion thus far that the inverse Laplace transform of any 
rational function can be computed by means of a partial fraction expansion followed 
by use of the formulas from Table 2.4. For partial fractions with irreducible 
quadratic denominator, the recursion formulas, as collected in Table 2.5, may be 
needed. Here is an example. 


Example 12. Find the inverse Laplace transform of 


6s + 6 
(s? — 4s + 13)?" 


F(s)= 


> Solution. We first complete the square: s* — 4s + 13 = s*-—4s4+44+9 = 
(s — 2)? + 3*. Then 


- 6s + 6 _ 1 f 68-2) +18 
(@-2)? + a ((s — 2)? + = 


_ 42 -1 s =I 3 
= (sc lam} +6 lwarm}) 


LU {F(sjp}=L 
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2t 


6 
=; =i (31 sin 3¢ — (31)? cos 3¢ + (3 — (31)) sin 3¢ — 3(31) cos 31) 


2t 
oe ((1 +t — 327) sin 3¢ — (3¢ + 317) cos 32) . 


The third line is obtained from Table 2.5 with b = 3 andk = 3. a 


Irreducible Quadratics and the Laplace Transform Method 


We conclude with an example that uses the Laplace transform method, quadratic 
partial fraction recursion, and Table 2.5 to solve a second order differential equation. 


Example 13. Use the Laplace transform method to solve the following differential 
equation: 

y" + 4y = 9rsint, 
with initial conditions y(0) = 0, and y’(0) = 0. 


> Solution. Table 2.5 gives £{9t sint} = 18s/(s* + 1). Now apply the Laplace 
transform to the differential equation to get 


18s 


2 _ 
+416) = aap 


and hence 
18s 


~ (82 + 1)2(s2 + 4) 


Using quadratic partial fraction recursion, we obtain the (s* + 1)-chain 


Y(s) 


The (s* + 1)-chain 


18s 6s 
(s? + 1)?(s? + 4) (se)? 
—6s —2s 
(s2 + 1)(s? + 4) s2+1 
2s 
s?+4 
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Thus, 
6s —2s 2s 


Y(s) = . 
(s) (Lie 241? eae 


Laplace inversion with Table 2.5 gives 


y(t) = 3t sint —2cost + 2cos2t. 


161 


162 2 The Laplace Transform 


2.5, 


Laplace Inversion 


Exercises 


1-18. Compute £7! { F(s)} (t) for the given proper rational function F(s). 


1, 


—5 


s243 
2s —5 
se +6s+9 
2s—5 
(s + 3)3 
6 
s2+25—8 
Ss 


s?—55+6 

2s? —5s+1 
(s —2)* 
2s +6 
s?—6s+5 
4s? 


~ (s— 18 +1)? 


27 
s3(s + 3) 
8s + 16 


5s +15 
(s2 + 9)(s — 1) 
12 


s2(s + 1)(s — 2) 


2s 
(s — 3)3(s — 4)? 
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19-24. Use the first translation principle and Table 2.2 (or Table 2.4) to find the 
inverse Laplace transform. 


19, — 
s?+2s4+5 
1 
s?+ 6s +10 
s—l 
s?—85 +17 
2s+4 
" s2— 454 12 
s—1l 
"52-254 10 
s—5 
" s2—6s 4 13 


20. 


21. 


24 


25-34. Find the inverse Laplace transform of each rational function. Either the 
reduction formulas, Proposition 8, or the formulas in Table 2.5 can be used. 
85 
(s2 + 492 
9 
(s? + 9)? 
2s 
(s? + 4s + 5)? 
2s +2 
(s? — 65 + 10)? 
2s 
(s? + 8s + 17)? 
s+1 
(s? + 2s + 2)3 
1 
(s? —2s + 5)3 
85 
(s? — 6s + 10)3 
s—4 
(s? — 8s + 17)4 
2 
(s? + 4s + 8)3 


25. 


26. 


27. 


28. 


29. 


30. 


31; 


32. 


33; 


34. 
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35-38. Use the Laplace transform method to solve the following differential 
equations. (Give both Y(s) and y(t).) 

35. y"+y=4sint, y(0)=1, y’(0)=-1 

36. y” + 9y = 36 sin3t, y(0) =0, y’(0) = 3 

37. y" —3y =4t’ cost, y(0) =0, y’(0) = 0 

38. y” + 4y = 32tcos2t, y(0)=0, y’(0) =2 


39-44. Verify the following assertions. In each assertion, assume a, b, c are distinct. 
These are referred to as Heaviside expansion formulas of the first kind. 


o 1 _ eat et 
oe aoaccn} a =a 
4 Ss _ ae be?! 
ae ls} ~ a-b zs b-a 
_ 1 = eat elt 
ala Srey, = @-ba-q * b-ab-o * 
ec! 
(c —a)(c —b) 
= Ss = ae" be?! 
an lacaecnecal G@-pa-9 | b-ab-a * 
ce! 
(c —a)(c —b) 
o g2 - azett bet 
= ‘oan os - @-ba-9 * b-ab-9 * 
Cet 
(c=a)(¢ =) 
k karit k arnt 
AA. Lo! » = AS er fa h 
ees 7c ee 78 
q(s) = (s —1r,)-+:(s — rg). Assume r},..., 7, are distinct. 


45-50. Verify the following assertions. These are referred to as Heaviside expan- 
sion formulas of the second kind. 


_ 1 ‘ 
45. £ Acer = te” 


46. Lo! loom} = (1 +. at)e” 


1 t? 
47, £71} —_§ = —e@ 
loca} - 
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2.6 The Linear Spaces €,: Special Cases 


Let g(s) be any fixed polynomial. It is the purpose of this section and the next to 
efficiently determine all input functions having Laplace transforms that are proper 
rational functions with qg(s) in the denominator. In other words, we want to describe 
all the input functions y(t) such that 


Liy(t)} (s) = a6) 


where p(s) may be any polynomial whose degree is less than that of g(s). It turns 
out that our description will involve in a simple way the roots of qg(s) and their 
multiplicities and will involve the notion of linear combinations and spanning sets, 
which we introduce below. To get an idea why we seek such a description, consider 
the following example of a second order linear differential equation. The more 
general theory of such differential equations will be discussed in Chaps. 3 and 4. 


D(s) 
q 


Example 1. Use the Laplace transform to find the solution set for the second order 
linear differential equation 
y =3y =4y = 0 (1) 


> Solution. Notice in this example that we are not specifying the initial conditions 
y(0) and y’(0). We may consider them arbitrary. Our solution set will be a family 
of solutions parameterized by two arbitrary constants (cf. the discussion in Sect. 1.1 
under the subheading The Arbitrary Constants). We apply the Laplace transform to 
both sides of (1) and use linearity to get 


L fy") —3£ fy} —4£ fy} = 0. 


Next use the input derivative principles: 


Liy'(t)} (s) = s£ {y(t} (s) — y(0), 
Lily" (t)} (8) = 9° L{y@} (8) — sy) — yO) 
to get 
s°¥(s) — sy(0) — yO) — 3(s¥(s) — y(0)) — 4Y¥(s) = 0, 
where as usual we set Y(s) = L{y(t)} (s). Collect together terms involving Y(s) 
and simplify to get 


(s° — 3s — 4)¥(s) = sy(0) + yO) — 3y(0). (2) 


The polynomial coefficient of Y(s) is s? — 3s — 4 and is called the characteristic 
polynomial of (1). To simplify the notation, let g(s) = s* — 3s —4. Solving for Y(s) 
gives 
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sy(0) + y'(0)—3y@) _ p(s) 
s?— 35-4 qs)’ 


where p(s) = sy(0) + y’(0) — 3y(0). Observe that p(s) can be any polynomial of 

degree | since the initial values are unspecified and arbitrary. Our next step then is 

to find all the input functions whose Laplace transform has q(s) in the denominator. 

Since q(s) = s* — 3s —4 a (s — 4)(s + 1), we see that the form of the partial 
Pp 


fraction decomposition for me is 


Y(s) = (3) 


Laplace inversion gives 
y(t) = cre™ + coe, (4) 


where c; and c2 are arbitrary real numbers, that depend on the initial conditions y (0) 
and y’(0). We encourage the student to verify by substitution that y(t) is indeed a 
solution to (1). We will later show that all such solutions are of this form. We may 
now write the solution set as 


{cie +oe':c1,C2 € R} ; (5) 
< 


Let us make a few observations about this example. First observe that the 
characteristic polynomial q(s) = s? — 3s — 4, which is the coefficient of Y(s) 
in (2), is easy to read off directly from the left side of the differential equation 
y”—3y'—4y = 0; the coefficient of each power of s in q(s) is exactly the coefficient 
of the corresponding order of the derivative in the differential equation. Second, 
with the characteristic polynomial in hand, we can jump to (3) to get the form of 
Y(s), namely, Y(s) is a proper rational function with the characteristic polynomial 
in the denominator. The third matter to deal with in this example is to compute y(t) 
knowing that its Laplace transform Y(s) has the special form Or It is this third 
matter that we address here. In particular, we find an efficient method to write down 
the solution set as given by (5) directly from any characteristic polynomial g(s). The 
roots of g(s) and their multiplicity play a decisive role in the description we give. 

For any polynomial q(s), we let , denote all the proper rational functions that 
may be written as eS for some polynomial p(s). We let €, denote the set of all 
input functions whose Laplace transform is in R,. In Example 1, we found the 
&y = {cie* + oe! :¢1,0. € R}, where q(s) = s? —3s —4. If c; = 1 and cy = 0 
then the function e#’ = le’ + 0e~ € Ry. Observe though that £ {e”} = 4. At 
first glance, it appears that £ ier \ is not in €,. However, we may write 

1 l(s+1) s+1 


At — = = 
cote 4 Gee a 


Thus, £ {e*"} (s) € Ry and indeed e*’ is in €,. Ina similar way, e~ € Ey. 
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Recall from Sect. 2.2 the notion of a linear space of functions, namely, closure 
under addition and scalar multiplication. 
Proposition 2. Both E€, and R4, are linear spaces. 
Proof. Suppose non cH and ? res) 
are less than deg ac). Further, 


are in R, andc € R. Then deg p;(s) and deg po(s) 


o 2G) 4 pals) _ PFPA) Since addition of polynomials does not increase the 


q(s) q(s) q(s) 
degree, we have deg(pi(s) + pa(s)) < deg q(s). It follows that ee ee 


Req. 


is in 


Pi) _ errs) 
q( s) q(s) 
It follows that R, is closed under addition and scalar multiplication, and hence, R, 


is a linear space. Now suppose f; and f2 are in € andc € R. Then £{ fi} € R, 
and £ { fo} € R,. Further, 


© LIAt+ h}=L{At+Lth} € R,. From this, it follows that ff + fo € &. 
© Lichi} =cL{fi} € Rg. From this it follows that cf € Eq. 


is proper and has denominator q(s); hence, it is in Ry. 


It follows that Ey is closed under addition and scalar multiplication, and hence, €, 
is a linear space. Oo 


Description of E, for q(s) of Degree 2 


The roots of a real polynomial of degree 2 occur in one of three ways: 


1. Two distinct real roots as in Example | 
2. A real root with multiplicity two 
3. Two complex roots 


Let us consider an example of each type. 
Example 3. Find €, for each of the following polynomials: 


1. g(s) =s*—39 +2 
2. g(s) =s*-—2s4+1 
3. g(s) =s* +2542 


> Solution. In each case, deg g(s) = 2; thus 


p(s) 


Rg = AG a) : deg p(s) < 1 
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1. Suppose f(t) € €,. Since q(s) = s?—3s +2 = (s—1)(s—2),a sae Pechon 
decomposition of L{f(t)}(s) = nel a has the form 7 oe 5 Gear 


Laplace inversion then gives f(t) = Lo! {aah = = cye’ + coe*’. On the other 


hand, we have e’ € €, since £ {e’} = a = ep = D 
e” € E&,. Since E, is a linear space, it follows that all functions of the form 


ce’ + cre” are in €,. From these calculations, it follows that 


€ R,. Similarly, 


Eq = {cie + Ce 301,00 € R}. 


2. Suppose f(t) € E,. Since g(s) = s? — 2s + 1 = (s — 1)’, a partial fraction 


decomposition of £{ f(t)} (s) = a has the form 7 = = f+ Go? . Laplace 


inversion then gives f(t) = L7 1 {2} = cyje’ + cote’. On the other hand, we 


q(s) 


have e' € €, since L{e'} = 4+ = ae = oO € Rg. Similarly £ {te’} = 


<7 € Ry so te’ € E,. Since E, is a linear space, it follows that all functions 


of the form c,e’ + cote! are in €,. From these calculations, it follows that 
Eq = {c1e’ + cate’: c1,c2 ER}. 


3. We complete the square in qg(s) to get g(s) = (s + 1)? + 1, an irreducible 
quadratic. Suppose f(t) € €,. A partial fraction decomposition of £{ f(t)} = 
7G} has the form 

p(s) _ ast+b 
(s+1?+1 (s+1)?4+1 
_ags+l1)+b-a 
~  (s+1)?41 
s+l1 1 
Veda” (sana 


where c; = a and c2 = b — a. Laplace inversion then gives 


P(s) 
q(s) 


Pad =cye ‘sint + ce‘ cost. 


fy =e {PS 


On the other hand, we have e~' cost € E, since £L {e™ cost} = eae € Ry. 
Similarly, we have e sint € €,. Since €, is a linear space, it follows that all 


functions of the form cje~! cost + c2.e~ sint are in €,. It follows that 


= (cre sint + oe cost :c1,¢2 € R} ; w 
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In Example 3, we observe that €, takes the form 
Eq = {e161 + Crd : C1, C2 € R}, 


where 


incase(1) \(t) =e! and ¢2(t) = e” 
incase (2) ¢i(t) = e’ and g(t) = te’ 
incase (3) i(t) =e sint and ¢o(t) = e cost 


We introduce the following useful concepts and notation that will allow us to 
rephrase the results of Example 3 in a more convenient way and, as we will see, will 
generalize to arbitrary polynomials g(s). Suppose F is a linear space of functions 
and S = {¢1,...,¢n} C F a subset. A linear combination of S is a sum of the 
following form: 

cig) ap ae CnPns 


where c,,...,C, are scalars in R. Since F is a linear space (closed under addition 
and scalar multiplication), all such linear combinations are back in F. The span of 
S, denoted Span S, is the set of all such linear combinations. Symbolically, we write 


Span S = {cy@) +-+- + Cnbn  C1,.--5Cn € R}. 


If every function in F can be written as a linear combination of S, then we say S 
spans F. Alternately, S is referred to as a spanning set for F. Thus, there are two 
things that need to be checked to determine whether S is a spanning set for F: 


© SCF. 
¢ Each function in ¥ is a linear combination of functions in S. 


Returning to Example 3, we can rephrase our results in the following concise 
way. For each qg(s), define B, as given below: 


1. q(s) =s?-38+2=(9-1)(s—2) B, = {e', e*} 
2. q(s) =s?-2s+1=(s—1) By =e", te} 
By 


3. g(s) =(s +17 +1 = fe‘ cost, e‘ sint} 
Then, in each case, 
€, = Span By. 


Notice how efficient this description is. In each case, we found two functions that 
make up B,. Once they are determined, then €, = Span B, is the set of all linear 
combinations of the two functions in B, and effectively gives all those functions 
whose Laplace transforms are rational functions with g(s) in the denominator. The 
set B, is called the standard basis of E,. 

Example 3 generalizes in the following way for arbitrary polynomials of 
degree 2. 
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Theorem 4. Suppose q(s) is a polynomial of degree two. Define the standard basis 
B, according to the way q(s) factors as follows: 


l.g(s)=(s—n)(s—rm) By = fe", eF} 
2. q(s) = (s—r)* Bo =e ie} 
3. g(s) =((s—a)?+b*) ~~ By = {e" cosbt, e” sin br} 


We assume 1, 12, r, a, and b are real, r; A 12, and b > 0. Let Ey be the set 
of input functions whose Laplace transform is a rational function with q(s) in the 
denominator. Then 


€, = Span By. 
Remark 5. Observe that these three cases may be summarized in terms of the roots 
of q(s) as follows: 


1. If g(s) has distinct real roots r; and rz, then By, = {e""’, e”"}. 

2. If g(s) has one real root r with multiplicity 2, then B, = {e’’, te’’}. 

3. If g(s) has complex roots a + bi, then By, = {e” cosbt, e“ sinbt}. Since 
sin(—bt) = — sin bt and cos(—bt) = cos bt, we may assume b > 0. 


Proof. The proof follows the pattern set forth in Example 3. 


1. Suppose f(t) € €,. Since g(s) = (s—r1)(s—rz), a partial fraction decomposition 


of L{f(t)} (s) = 7G has the form 7 NG 5 = t+ Sy. Laplace inversion 
then gives f(t) = L! {2a = cye"! + cye’’, On the other hand, we have 


1 —= sor a2 S=P Sa rot 
—r1 60) ~ as) = Ry. Similarly, e" € Eq. 


e"!’ € €, since £{e} = - 
It now follows that 


€q — Jere + coe”?! 2C1,02 € R} : 


2. Suppose f(t) € €,. Since q(s) = (s — r)*, a partial fraction decomposition of 
Lif(t)}(s) = ae has the form ES =o 4+ Gop: Laplace inversion then 
gives f(t) = £7! {2a = cy e™ + cote”. On the other hand, we have e” € E, 


since Life™} = = = ane = a E Raq: Similarly, L {te™} (s) _ 3 € 


R, so te” € E,. It now follows that 


Eq = {cre + cote” : c1,c2 ER}. 


3. Suppose f(t) € €,. A partial fraction decomposition of £ { f(t)} = 7G} has the 
form 
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p(s) _ cs +d 
((s—a)?+b2) ((s—a)? +b?) 
_ ¢@—a) +d +ca 
— (say +b?) 
S—a b 
= OU Greg ea pe WEE ge qe 


d+ca 


where c; = c and cz = |“. Laplace inversion then gives 
{Ose ret = cye" cosbt + ce” sin bt. 
q(s) 


On the other hand, since £ {e“’ cos bt} = Gray tbz 
€, . Similarly, we have e“ sin bt € E,. It follows that 


€ Ry, we have e” cos bt € 


Ey = {cie“ sint + ce cost : c1,c2 € R}. 


In each case, €, = Span B,, where B, is prescribed as above. Oo 


This theorem makes it very simple to find B, and thus €, when deg q(s) = 2. 
The prescription boils down to finding the roots and their multiplicities. 


Example 6. Find the standard basis 6, of €, for each of the following 
polynomials: 


1. q(s) =s*? +6545 
2. q(s) =s* +454+4 
3. g(s) =s*7 +45 +13 


> Solution. 1. Observe that g(s) = s? + 6s + 5 = (s + 1)(s +5). The roots are 
r, = —landrz = —5. Thus, B, = cae et and €, = Span By. 

2. Observe that g(s) = s*+4s+4 = (s+2)?. The root is r = —2 with multiplicity 
2. Thus, By = heey fe and €, = Span By. 

3. Observe that g(s) = s? + 4s + 13 = (s + 2)? + 3? is an irreducible 
quadratic. Its roots are —2 + 31. Thus, B, = oa cos 3t, e~2" sin 3r\ and €, = 
Span By. < 


As we go forward, you will see that the spanning set 6, for €,, for any 
polynomial qg(s), will be determined precisely by the roots of q(s) and their 
multiplicities. We next consider two examples of a more general nature: when 
q(s) is (1) a power of a single linear term and (2) a power of a single irreducible 
quadratic. 
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Power of a Linear Term 


Let us now consider a polynomial which is a power of a linear term. 


Proposition 7. Forr € R, let 


q(s) = (81). 
Then 
B _ {e* te” pe 
¢ = ; aes 
is a spanning set for Eq. 


Remark 8. Observe that 6, only depends on the single root r and its multiplicity 
n. Further, B, has exactly n functions which is the same as the degree of q(s). 


Proof. Suppose f(t) € €,. Then a partial fraction decomposition of £ { f(t)} (s) = 
PS) has the form 
qs) 

D(s) 1 1 1 


=@ a -++ ++ Ga >-——_.. 
(s—r)" ‘sor? *(s—ry (s—r)" 


Laplace inversion then gives 


| 
q(s) 


2 pr-t 
= aye + ante +a3;—e +--- +a, rt 


fo sae 2! (@—)D!- 


II 


ce" + cote” + 3t7e" fee tent! le, 


where, in the second line, we have relabeled the constants ai = c,. Observe that 


. k! ki — rj 
Lftke™\ = = e€,. 
{ € } (s —r)kt1 (s—r)" q 
If 
p= fe", te’ ..., ee 
then it follows that 
€, = Span By. Oo 


Example 9. Let g(s) = (s — 5)‘. Find all functions f so that L { f}(s) has q(s) in 
the denominator. In other words, find €,. 


> Solution. We simply observe from Proposition 7 that 
B, = fe, te, 0, Bei 


and hence €, = Span B,. < 
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Power of an Irreducible Quadratic Term 


Let us now consider a polynomial which is a power of an irreducible quadratic 
term. Recall that any irreducible quadratic s? + cs + d may be written in the form 
(s — a)? + b*, where a + b are the complex roots. 


Lemma 10. Let n be a nonnegative integer; a, b real numbers; and b > 0. Let 
q(s) = ((s — a)? +b)". Then 


tke cosbt € Ey and tke" sinbt € Eq, 
forallk =0,...,n—1. 
Proof. We use the translation principle and the transform derivative principle to get 
L {ike cos bt}(s) = L {r* cos bt} (s — a) 


Es (-1)L feos br} 


H>(s—a) 


&) . 
An induction argument which we leave as an exercise gives that (=z) isa 


proper rational function with denominator (s* + b?)*+!. Replacing s by s —a gives 


p(s) 
((s a a) + b2)k+1 i 


L {tke cos bt}(s) = 
for some polynomial p(s) with deg p(s) < 2(k + 1). Now multiply the numerator 
and denominator by ((s — a)? + b7)"~*~! to get 


P(s)(s — a)” + p2yn-k-1 
((s — a2)? + b2)" , 


L fret cos bt} (s) = 


fork = 0,...,2 — 1. Since the degree of the numerator is less that 2(k + 1) + 
2(n—k —1) = 21, it follows that £ {t*et cos bt} € €,. A similar calculation gives 
L {i* et! sin bt} € Eq. Oo 


Proposition 11. Let 
q(s) = ((s — a)? + b*)" 
and assume b > 0. Then 
b= {e” cos bt,e” sin bt, te“ cos bt, te“ sin bt, 
. te" cos bt,” be” sin bt} 


is a spanning set for Eq. 
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Remark 12. Since cos(—bt) = cos bt and sin(—bt) = — sin bt, we may assume 
that b > 0. Observe then that B, depends only on the root a + ib, where b > 0, of 
q(s) and the multiplicity n. Also 6, has precisely 2n functions which is the degree 


of q(s). 
Proof. By Lemma 10, each term in B, is in €,. Suppose f(t) € €&, and 
L{f(t)}(s) = 2 for some polynomial p(s). A partial fraction decomposition 


q(s) 
of 2 has the form 
qs) 
p(s) _ ays +b, aos + by anS + by 


+ 


io =o 58) Ga ee Gaeree O™ 


By Corollary 11 of Sect. 2.5 and the first translation principle, (2) of Sect.2.5, the 


inverse Laplace transform of a term eed has the form 


-1 ars + by 


cera = px (te cos bt + qx(t)e™ sin bt, 


where p; (t) and q(t) are polynomials of degree at most A —1. We apply the inverse 
Laplace transform to each term in (6) and add to get 


ese 


= p(t)e” cos bt + q(t)e™ sin bt, 
q(s) 


where p(t) and g(t) are polynomials of degree at most n — 1. This means that 


f= {2 ~ \ is a linear combination of functions from B, as defined above. 


qs) 


It follows now that 


€, = Span By. Oo 


Example 13. Let g(s) = ((s — 3)* + 27)3. Find all functions f so that £{ f(s) 
has q(s) in the denominator. In other words, find €,. 


> Solution. We simply observe from Proposition 11 that 
By = fe cos 2t, e* sin 2r, te* cos 2t, te sin 2t, t7e* cos 2t, te” sin 2t,} 


and hence €, = Span B,. < 
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Exercises 


1-25. Find the standard basis 6, of €, for each polynomial g(s). 


l. g(s)=s-4 

2. gis) =s+6 

3. g(s) = s? +. 5s 

4. q(s) = s*—3s-—4 

5. q(s) =s?-6s +9 

6. g(s) = s?—9s4 14 
7. q(s) =s?-s—6 

8. g(s) = 5s? + 9s + 18 
9. q(s) = 6s? —1ls +4 
10. g(s) =s?+2s—-1 
11. g(s) =s?-—45+1 
12. g(s) = s? — 10s + 25 
13. g(s) = 4s? + 12s +9 
14. g(s) =s? +9 

15. q(s) = 48? + 25 

16. g(s) =s? +45 +13 
17. g(s) = s?-—25 +5 
18. g(s) =s?-s4+1 

19. g(s) = (s + 3)4 
20. g(s) = (s—2)° 
21. q(s) = s3 —3s7 +35 —1 
22. q(s) = (s + 1)° 
23. q(s) = (s? + 4s + 5)? 
24. q(s) = (s? — 8s + 20)? 
25. q(s) = (s? + 1)4 
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2.7 The Linear Spaces €,: The General Case 


We continue the discussion initiated in the previous section. Let g(s) be a fixed 
polynomial. We want to describe the linear space €, of continuous functions 
that have Laplace transforms that are rational functions and have gq(s) in the 
denominator. In the previous section, we gave a description of €, in terms of a 
spanning set 6, for polynomials of degree 2, a power of a linear term, and a power 
of an irreducible quadratic. We take up the general case here. 


Exponential Polynomials 


Let n be a nonnegative integer, and a,b € R, and assume b > 0. We will refer to 
functions of the form 


te“ cosbt and t”e” sinbt, 


defined on R, as simple exponential polynomials. We introduced these functions in 
Lemma 10 of Sect. 2.6. Note that if b = 0, then te“ cosbt = t"e, and if both 
a = Oand b = 0, then t”e“ cos bt = t”. Thus, the terms 


t® et and t? 


are simple exponential polynomials for all nonnegative integers n and real numbers 
a.Ifn = O anda = 0, then t"e“ cosbt = cosbt and t"e“ sinbt = sin bt. Thus, 
the basic trigonometric functions 


cosbt and sinbt 


are simple exponential polynomials. For example, all of the following functions are 
simple exponential polynomials: 


1 #8 2. tceos2r 3. ev 4, te% 5. tte sin 3¢ 


while none of the following are simple exponential polynomials: 


in 2t f 
saat 8. te’? 9. sine’) 10. < 


cos 2t 


We refer to any linear combination of simple exponential polynomials as an 
exponential polynomial. In other words, an exponential polynomial is a function in 
the span of the simple exponential polynomials. We denote the set of all exponential 
polynomials by €. All of the following are examples of exponential polynomials 
and are thus in €: 
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1. ef +2e% 4+ 3e% 2. #esin3t+2te’cosSt 3. 1—-t+r?—24+14 
4. t—2tcos3t 5. 3e7 + 4te?! 6. 2cos4t —3sin4t 


Definition of By, 


Recall that we defined €, to be the set of input functions whose Laplace transform 
is in Ry. We refine slightly our definition. We define €, to be the set of exponential 
polynomials whose Laplace transform is in ?,. That is, 


Eg ={f EE: LEFF ER}. 


Thus, each function in €, is defined on the real line even though the Laplace 
transform only uses the restriction to [0,0o).4 We now turn our attention to 
describing €, in terms of a spanning set B,. In each of the cases we considered 
in the previous section, B, was made up of simple exponential polynomials. This 
will persist for the general case as well. Consider the following example. 


Example 1. Let g(s) = (s — 1)?(s? + 1)’. Find a set B, of simple exponential 
polynomials that spans €,. 

> Solution. Recall that €, consists of those input functions f(f) such that £ { f(t)} 
is in Ry. In other words, £ { f(t)} (s) = 4 for some polynomial p(s) with degree 


qs)’ 
less than that of g(s). A partial fraction decomposition gives the following form: 


p(s) — 1 4 a2 # a3 a4s + a5 apS + a7 
(s—1)3(s? +1) s—-1 (s—1)? (s—1)3 s? +] (s? + 1)? 


_ Pils) p2(s) 
~ (s—1)3 (2 4.1)?’ 


where p(s) is a polynomial of degree at most 2 and p2(s) is a polynomial of degree 


; ae : . p(s) 
at most 3. This decomposition allows us to treat Laplace inversion of G=p'GtD? 
Pils) p2(s) 


in terms of the two pieces: (—D? G2EDE" In the first case, the denominator is 
a power of a linear term, and in the second case, the denominator is a power of an 
irreducible quadratic. From Propositions 7 and 11 of Sect. 2.6, we get 


and 


co! Pils) 


=ce +ete’ +.c307e', 
qi(s) 


4In fact, any function which has a power series with infinite radius of convergence, such as an 
exponential polynomial, is completely determined by it values on [0, 00). This is so since f(t) = 


ve LY 7 and f™ (0) are computed from f(t) on [0, 00). 


n=0 nl 
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Lo et = c4cost + cs5sint + cst cost + c7t sint, 
q2(s) 
where c1,...,C7 are scalars, gi(s) = (s — 1)?, and q2(s) = (s* + 1)’. It follows 
now by linearity of the inverse Laplace transform that 
= p(s) 
a ee 
ees Cem cee} 


= cye’ + ote! +.¢3t7e! + cacost + c5 sint + cet cost + c7t sint. 


Thus, if 
Be = {ete t?e’, cost, sint,t cost, t sin t} 


then the above calculation gives €, = Span B,. Also observe that we have shown 
that B, = By, U By). Further, the order of B,, which is 7, matches the degree of 


q(s). <q 


From this example, we see that B, is the collection of simple exponential 
polynomials obtained from both B,, and B,,, where qi(s) = (s — 1)? and qo(s) = 
(s?+1)? are the factors of q(s). More generally, suppose that q(s) = qi(s)-::qr(s), 
where q;(s) is a power of a linear term or a power of an irreducible quadratic term. 
Further assume that there is no repetition among the linear or quadratic terms. Then 
a partial fraction decomposition can be written in the form 


p(s) _ Pils) | | PR(S) 
q(s) gis) qr(s) 


p(s) 


qs) 


We argue as in the example above and see that £7! \ is a linear combination of 


those simple exponential polynomial gotten from B,,,..., By,. If we define 
By = By, U---U Bap 


then we get the following theorem: 


Theorem 2. Let g(s) be a fixed polynomial of degree n. Suppose q(s) = 
qi(s)---qr(s) where qj(s) is a power of a linear or an irreducible term and 
there is no repetition among the terms. Define By = By, U+++U Bagg. Then 


Span By = &. 


Further, the degree of p(s) is the same as the order of Bg. 


Proof. The essence of the proof is given in the argument in the previous paragraph. 
More details can be found in Appendix A.3. oO 
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It is convenient to also express 8, in terms of the roots of q(s) and their 
multiplicities. We put this forth in the following algorithm. 


Algorithm 3. Let g(s) be a polynomial. The following procedure is used to 
construct B,, a spanning set of €,. 


Description of 6, 
Given a polynomial q(s): 
1. Factor q(s) and determine the roots and their multiplicities. 


2. For each real root r with multiplicity m, the spanning set Bg will contain 
the simple exponential functions: 


rt m—1 rt 
ey ees : 


ete e 


3. For each complex root a + ib (b > 0) with multiplicity m, the spanning 
set By will contain the simple exponential functions: 


e" cos bt, e@ sinbt, ..., 0” 'e” cos bt, t”~'e@ sin bt. 


Example 4. Find B, if 

1. g(s) = 4(s — 3)?(s — 6) 

2. g(s) = (s + Is? +.) 

3. q(s) = 7(s — 1)3(s — 2)?((s — 3)? + 5’)? 

> Solution. 

1. The roots are 7; = 3 with multiplicity 2 and r2 = 6 with multiplicity 1. Thus, 


By _ fe, te, ef} 


2. The roots are r = —1 with multiplicity 1 anda + ib = 0+71. Thus, a = 0 and 
b = 1. We now get 
B= cae cost, sint}. 


3. The roots are r; = 1 with multiplicity 3, 7. = 2 with multiplicity 2, anda+ib = 
3 + 51 with multiplicity 2. We thus get 


be= {e’, te’, t?e’, e*, te, e* cos Sr, e* sin 5t, te™ cos 5t, te” sin 5t} _< 
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Laplace Transform Correspondences 


We conclude this section with two theorems. The first relates € and R by way of the 
Laplace transform. The second relates €, and R,. The notion of linearity is central 
so we establish that € and 7 are linear spaces. First note the following lemma. 


Lemma 5. Suppose S is a set of functions on an interval I. Let ¥ = Span S. Then 
F is a linear space. 


Proof. If f and g are in Span S, then there are scalars a),...,d, and bj,..., bm so 
that 
f=afit--+tah and g=bg,t+---+bngm, 


where f|,..., f, and g1,...,%m are in S. The sum 
fteg =a tee + an fh + bigy +-+++ din&m, 


is again a linear combination of function in S, and hence f + g € Span S. In 
a similar way, if c is a scalar and f = a, f, +--- + a, f, is in Span S, then 
cf = cay fit-+:-+cdn f, is a linear combinations of functions in S, andhencecf € 
Span S. It follows that Span S is closed under addition and scalar multiplication and 
hence is a linear space. Oo 


Recall that we defined the set € of exponential polynomials as the span of the set 
of all simple exponential polynomials. Lemma 5 gives the following result. 


Proposition 6. The set of exponential polynomials E is a linear space. 
Proposition 7. The set R of proper rational functions is a linear space. 


Proof. Suppose - re and a are in R andc € R. Then 


e Pils) 4 p2(s) __ pils)qa(s)+ pr(s)qi(s) 
ails) qa(s) qi(s)q2(s) 
in PR. 
© cms) — cpils) 
qi(s) qi(s) 
It follows that is closed under addition and scalar multiplication, and hence FR is 
a linear space. Oo 


is again a proper rational function and hence 


is a again a proper rational function and hence in R. 


Theorem 8. The Laplace transform 
L:E>R 


establishes a linear one-to-one correspondence between the linear space of expo- 
nential polynomials, E, and the linear space of proper rational functions, R. 
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Remark 9. This theorem means the following: 


1. The Laplace transform is linear, which we have already established. 

2. The Laplace transform of each f € € is a rational function. 

3. For each proper rational function r ¢€ ‘, there is a unique exponential 
polynomial f € € so that £{f} =r. 


Proof. By Lemma 10 of Sect. 2.6, the Laplace transforms of the simple exponential 
polynomials t"e“' cos bt and t"e“' sin bt are in R. Let d € €. There are simple 
exponential polynomials ¢),...,@, such that @ = cig; +++: + Cmbm, where 
C1,--+,Cm € R. Since the Laplace transform is linear, we have £L{@} = iL {fi} + 
-+> + Cm£ {dm}. Now each term £{¢;} € FR. Since FR is a linear space, we 
Lio} € R. It follows that the Laplace transform of any exponential polynomial 
is a rational function. 

On the other hand, a proper rational function is a linear combination of the simple 
rational functions given in (1) in Sect. 2.5. Observe that 


n—1 


= n t at 
£~" {1/(s —a)"} (s) = G=Dr 


is a scalar multiple of a simple exponential polynomial. Also, Corollary 11 of 
Sect. 2.5 and the first translation principle establish that both 1/((s — a)* + b?)* 
and s/((s—a)? + b*)* have inverse Laplace transforms that are linear combinations 
of t”e” sinbt and t"e“ cosbt for 0 < k <_n. It now follows that the inverse 
Laplace transform of any rational function is an exponential polynomial. Since 
the Laplace transform is one-to-one by Theorem | of Sect. 2.5, it follows that the 
Laplace transform establishes a one-to-one correspondence between € andR. O 


We obtain by restricting the Laplace transform the following fundamental 
theorem. 


Theorem 10. The Laplace transform establishes a linear one-to-one correspon- 
dence between E, and R,. In other words, 


Li Ey > Ry 


is one-to-one and onto. 
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Exercises 


1-11. Determine which of the following functions are in the linear space € of 
exponential polynomials. 

Le 

2, te 

3. t/e 

4. e'/t 

: uA 

5. t sin (41 = =) 


4 
6. (t +e’)? 
7. t+e)? 
8. te!/? 
9, t\/2e! 
10. sin 2t/e~ 
11. e*/sin2t 


12-28. Find the standard basis B, of €, for each polynomial ¢(s). 
12. gqis)=s? +s 

13. g(s)=s*-1 

14. g(s) = s3(s + 1)? 

15. q(s) = (s—1)3(s +7)? 

16. g(s) = (s + 8)?(s* + 9)3 

17. g(s) = (s + 2)3(s? + 4)? 

18. g(s) = (s + 5)?(s — 4)?(s + 3)? 
19. g(s) = (s — 2)°(s + 3)°(s + 3) 
20. g(s) = (s — 1)(s — 2)?(s — 3)7 
21. g(s) = (s + 4)?(s? + 6s + 13)? 
22. q(s) = (s + 5)(s* + 48 +5)? 
23. q(s) = (s — 3)3(s? + 2s + 10)? 
24. g(s) = 5° +8 

25. q(s) = 2s? — 5s? + 45-1 

26. g(s) = s3 + 2s? — 9s — 18 

27. q(s) = s4+5s? +6 

28. q(s) = s*— 8s? + 16 
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29-33. Verify the following closure properties of the linear space of proper rational 
Junctions. 


29. Multiplication. Show that if r;(s) and r2(s) are in R, then so is r1(s)ra(s). 

30. Translation. Show that if r(s) is in R, so is any translation of r(s), that is, 
r(s —a) € R for any a. 

31. Differentiation. Show that if r(s) is in R, then so is the derivative r’(s). 

32. Let q(s) = (s — a)* + b?. Suppose r(s) € Ryn but r(s) ¢ Ryn. Then 
r'(S) © Rants but r'(s) € Rqn. 

33. Let g(s) = (s —a)? + b*. Letr € Rg. Then r™ € Ryn41 but not in Rg. 


34-38. Verify the following closure properties of the linear space of exponential 
polynomials. 


34. Multiplication. Show that if f and g are in €, then so is fg. 

35. Translation. Show that if f is in €, so is any translation of f, i.e. f(t —to) € E, 
for any fo. 

36. Differentiation. Show that if f is in €, then so is the derivative /’. 

37. Integration. Show that if f is in €, then so is f f(t)dt. That is, any 
antiderivative of f is in €. 

38. Show that € is not closed under inversion. That is, find a function f so that 1/f 
is notin €. 


39-41. Let g(s) be a fixed polynomial. Verify the following closure properties of 
the linear space Eq. 


39. Differentiation. Show that if f is in €,, then f’ is in Ey. 

40. Show that if f is in €,, then the nth derivative of f, f, is in &q. 

41. Show that if f € €,, then any translate is in €,. That is, if to € R, then f(t — 
to) € &y. 
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2.8 Convolution 


Table 2.3 shows many examples of operations defined on the input space that 
induce via the Laplace transform a corresponding operation on transform space, 
and vice versa. For example, multiplication by —? in input space corresponds to 
differentiation in transform space. If F(s) is the Laplace transform of f(t), then 
this correspondence can be indicated as follows: 


—tf(t)<— ote, 
ds 


Our goal in this section is to study another such operational identity. Specifically, 
we will be concentrating on the question of what is the operation in the input space 
that corresponds to ordinary multiplication of functions in the transform space. Put 
more succinctly, suppose f(t) and g(t) are input functions with Laplace transforms 
F(s) and G(s), respectively. What input function /(t) corresponds to the product 
H(s) = F(s)G(s) under the Laplace transform? In other words, how do we fill in 
the following question mark in terms of f(t) and g(t)? 


FEO. 


You might guess that h(t) = f(t)g(t). That is, you would be guessing that 
multiplication in the input space corresponds to multiplication in the transform 
space. This guess is wrong as you can quickly see by looking at almost any example. 
For a concrete example, let 


F(s)=1/s and G(s) = 1/s?. 


Then H(s) = F(s)G(s) = 1/s? and h(t) = t?/2. However, f(t) = 1, g(t) = ¢, 
and, hence, f(t)g(t) = t. Thus h(t) 4 f(t)g(t). 

Suppose f and g are continuous functions on [0, co). We define the convolution 
(product), (f * g)(t), of f and g by the following integral: 


(iO = [ fg(t — uw) du. (1) 


The variable of integration we chose is u but any variable other than ¢t can be used. 
Admittedly, convolution is an unusual product. It is not at all like the usual product 
of functions where the value (or state) at time ¢ is determined by knowing just the 
value of each factor at time ¢. Rather, (1) tells us that the value at time t depends on 
knowing the values of the input function f and g for all u between 0 and t. They 
are then “meshed” together to give the value at f. 
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The following theorem, the convolution theorem, explains why convolution is so 
important. It is the operation of convolution in input space that corresponds under 
the Laplace transform to ordinary multiplication of transform functions. 


Theorem 1 (The Convolution Theorem). Let f(t) and g(t) be continuous func- 
tions of exponential type. Then f * g is of exponential type. Further, if F(s) = 
Lif (t)} (s) and G(s) = Li{g(t)} (8), then 


The Convolution Principle 
LAF * g)(t)} (8) = F(s)G(s) 
or (f * g)(t) =L7' {F(s)- G(s))} @. 


The second formula is just the Laplace inversion of the first formula. The proof 
of the convolution principle will be postponed until Chap. 6, where it is proved for 
a broader class of functions. 

Let us consider a few examples that confirm the convolution principle. 


Example 2. Let 1 be a positive integer, f(t) = t", and g(t) = 1. Compute the 
convolution f * g and verify the convolution principle. 


> Solution. Observe that £ {t"} (s) = n!/s"t!, L {1} (s) = 1/s, and 
ytl t prt 


n+1|\, n+1 


fre f fluygtt udu = | u"-ldu= 


Further, 
prt 1 (+1)! nto 
f«8}6) =£] I oy) = SE = Se 
=Lif} Liss 
thus verifying the convolution principle. < 


Example 3. Compute f? * f° and verify the convolution principle. 


> Solution. Here we let f(t) = ¢° and g(t) = ?? in (1) to get 


tx 1? -f[ fudge —wau= fee —w? au 
0 0 


Bs ; ‘4 : 1° 6 6 6 
-_ t —2t du = —2 = : 
/ BE eM erie ie a 
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Additionally, 
: 16! 3! 2 
cifea clot o= 5-4-5 
=L{f}- Lig}. ig 


Example 4. Let f(t) = sint and g(t) = 1. Compute (f * g)(t) and verify the 
convolution principle. 


> Solution. Observe that F(s) = L{sint} = 1/(s? + 1), G(s) = L{1} = 1/s, 
and 


(f * g)(t) =). Fudge —w)du= f sinudu = —cosult = 1—cost. 


Further, 
Ltf * g} (8) = L{1 cost} (s) = +- = 
° 7 : gs st+1 
ties. T- . Ff - 1 
s(s?+1)  s(s?+1) s2?4+1 8 
= Lif} Lig}. < 


Properties of the Convolution Product 


Convolution is sometimes called the convolution product because it behaves in many 
ways like an ordinary product. In fact, below are some of its properties: 


Commutative property: fxg =exf 
ff *(g *h) 
Distributive property: f *(g +h) = fxgtfxh 
f*x0=0x*« f =0 
Indeed, these properties of convolution are easily verified from the definition 


given in (1). For example, the commutative property is verified by a change of 
variables: 


Associative property: (f*g)*h 


fxe®= i flu)g(t — u) du 


Let x = t —u then dx = —dt and we get 
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0 
- i Ft — x)g(x) (Dd 


= i g(x) f(t — x) dx 
ae ee 


It follows, for example, that 


b t 
ms1o= | ul du= f= 1)" du =e" #1. 
0 0 


Both integrals are equal. The decision about which one to use depends on which 
you regard as the easiest to compute. You should verify the other properties listed. 

There is one significant difference that convolution has from the ordinary product 
of functions, however. Examples 2 and 4 imply that the constant function 1 
does not behave like a multiplicative identity. In fact, no such “function” exists. 
Nevertheless, convolution by f(t) = 1 is worth singling out as a special case of the 
convolution principle. 


Theorem 5. Let g(t) be a continuous function of exponential type and G(s) its 
Laplace transform. Then (1 * g)(t) = te g(u) du and 


Input Integral Principle 
G(s) 
ae 


L SG g(u) du} — 


Proof. Since (1 * g)(t) = cp g(u) du, the theorem follows directly from the 
convolution principle. However, it is noteworthy that the input integral principle 
follows from the input derivative principle. Here is the argument. Since g is of 
exponential type, so is any antiderivative by Lemma 4 of Sect. 2.2. Suppose A(t) = 
te g(u) du. Then h’(t) = g(t), and A(0) = 0 so the input derivative principle gives 


G(s) = L{g(t)} = L {h'(t)} = sH(s) —h(0) = sH(s). 


Hence, H(s) = (1/s)G(s), and thus, 


ch [ ews = £tAW}(s) = LEG). o 
0 AY 


5In Chap. 6, we will discuss a so-called “generalized function” that will act as a multiplicative 
identity for convolution. 
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Remark 6. The requirement that g be of exponential type can be relaxed. It can be 
shown that if g is continuous on [0, oo) and has a Laplace transform so does any 
antiderivative, and the input integral principle remains valid.° 


The input integral and convolution principles can also be used to compute 
the inverse Laplace transform of rational functions. Consider the following two 
examples 


Example 7. Find the inverse Laplace transform of 


1 
s(s2 +1) 


> Solution. Instead of using partial fractions, we will use the input integral 


principle. Since £~! { \ = sint, we have 


1 
s2+1 


co =| = [sina 


= —cosu|j = 1 —cost. < 


Example 8. Compute the inverse Laplace transform of aaa 


> Solution. The inverse Laplace transforms of +5 re and ; — are cos 3t and e’, 
respectively. The convolution theorem now gives 


co 2 = cos 3t * e! 


(s — 1)(s? + 9) 
t 
=} cos 3u e’ “du 
0 


t 
=e f e “cos 3udu 
0 


e! 
10 (—e™ cos 3u + 3e™ sin 3u) |g 


II 


1 
Te cos 3t + 3sin3t +e"). 


The computation of the integral involves integration by parts. We leave it to the 
student to verify this calculation. Of course, this calculation agrees with Laplace 
inversion using the method of partial fractions. < 


®For a proof, see Theorem 6 and the remark that follows on page 450 of the text Advanced Calculus 
(second edition) by David Widder, published by Prentice Hall (1961). 
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Table 2.11 contains several general convolution formulas. The next few formulas 
verify some of the entries. 


Formula 9. Verify the convolution product 


ett — elt 
e *e = a (2) 


where a  b, and verify the convolution principle. 


V Verification. Use the defining equation (1) to get 


t t eat — et 
et! x elt = / elteb(t—w) du = on | e(a—b)u du = 
0 0 a—b 
Observe that 
et—e) 1 1 1 
a—b a—b\s—-a _ s-—b 

= 1 a. 1 

~ (s—a)\(s—b)  s—a s—b 

=Lf{e™-£{e"\, 
so this calculation is in agreement with the convolution principle. A 


Formula 10. Verify the convolution product 


exe" = te” (3) 


and verify the convolution principle. 


V Verification. Computing from the definition: 
t t 
ett * ett = / ell aa(t—w) du = e) du = tet 
0 0 


As with the previous example, note that the calculation 


1 
Lies = (s—ap =f je" } £ {e™} 7 


which agrees with the convolution principle. A 


Remark 11. Since 
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the previous two examples show that 


lim e xe” = 
a—>b 


so that the convolution product is, in some sense, a continuous operation. 


Formula 12. Verify the following convolution product where m,n > 0: 


«t= m!n! pintnatl 


~ (m+n+1)! 


V Verification. Our method for this computation is to use the convolution theorem, 
Theorem |. We get 


m! n! m!n! 


Lt «P= LUMLEY = = 


gmt] gn] gmtnt+2° 


Now take the inverse Laplace transform to conclude 


tm * t” = Lo m!\n! = m!n!} pntntl i 
gmtn+2 (m +n+1)! 
As special cases of this formula, note that 
1 1 
2797p S—7® and tat? = —7°. 
60 30 


The first was verified directly in Example 3. 
In the next example, we revisit a simple rational function whose inverse Laplace 
transform can be computed by the techniques of Sect. 2.5. 


1 


Example 13. Compute the inverse Laplace transform of Ga 


> Solution. The inverse Laplace transform of 1/(s* + 1) is sint. By the convolu- 
tion theorem, we have 
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1 
‘a loa = sint * sint. 
Ss 
t 
= sin u sin(t — u) du 
0 


t 
= sin u(sin tf cos u — sinucost) du 
0 


t t 
sin t / sin ucos udu — cost i sin? udu 
0 0 


. sin’ t t —sint cost 
sin t — cost 
2 2 


sint —t cost 
=o < 
2, 


Now, one should see how to handle 1/(s? + 1)? and even higher powers: repeated 
applications of convolution. Let f** denote the convolution of f with itself k times. 
In other words, 


f= fe feeee7, k times. 


Then it is easy to see that 


1 : 
Lo ( 24 1k | = sin* +) ¢ 
; re 


“1 s 
and CL @ + DF + Fri 


These rational functions with powers of irreducible quadratics in the denominator 
were introduced in Sect. 2.5 where recursion formulas were derived. 

Computing convolution products can be tedious and time consuming. In Table 
2.11, we provide a list of common convolution products. Students should familiarize 
themselves with this list so as to know when they can be used. 


k 


II 


cost * sin** ¢. 
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Exercises 


1-4. Use the definition of the convolution to compute the following convolution 
products. 


l. txt 
2.t*t 

3. 3 * sint 

4. (3t+1)*e" 


5-9. Compute the following convolutions using the table or the convolution princi- 
ple. 


5. sin2t * e* 

6. (2t + 1) * cos2t 
7. 1? xe 

8. cost * cos 2t 

9 


: e2! * ett 


10-15. Use the convolution principle to determine the following convolutions and 
thus verify the entries in the convolution table. 


10. t «t” 

11. e” * sinbt 
12. e” « cos bt 
13. sinat * sinbt 
14. sinat *« cos bt 


15. cosat * cos bt 


16-21. Compute the Laplace transform of each of the following functions. 
16. f(t) = fe — x) cos 2x dx 

17. f(t) = fo (t — x) sin 2x dx 

18. f(t) = f(t — xe dx 

19 OS fh eet dy 

20. f(t) = fj sin 2x cos(t — x) dx 

21. f(t) = fj sin 2x sin 2(¢ — x) dx 
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22-31. In each of the following exercises, use the convolution theorem to compute 
the inverse Laplace transform of the given function. 


22. 


23. 


24. 


25; 


26. 


27. 


28. 


29. 


30. 


31. 


32. 


1 
(s —2)(s + 4) 
1 
s2?—6s +5 
1 
(s? + 1)? 
s 
(s? + 1)? 
1 
(s + 6)s3 
2 
(s — 3)(s? + 4) 
S 
(s — 4)(s2 + 1) 
1 
(s —a)(s—b) 
G(s) 
s+2 


G(s) 


a#b 


s 
s*74+2 
Let f be a function with Laplace transform F(s). Show that 


co | =| is f (x9) dy dx}. 


More generally, show that 


e1} =| eee Me F (Xn) dXy ...dx2 dx}. 


33-38. Use the input integral principle or, more generally, the results of Problem 
32 to compute the inverse Laplace transform of each function. 


1 


33. ———__ 
s*(s? + 1) 


1 


34. —.— 
s2(s7— 4) 


2.8 


35. 


36. 


37. 


38. 


Convolution 


1 
s3(s + 3) 
1 
s2(s — 2) 
1 


5(s? + 9)? 


1 
se +s? 
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2.9 Summary of Laplace Transforms and Convolutions 


Laplace transforms and convolutions presented in Chap. 2 are summarized in Tables 
2.6—2.11. 


Table 2.6 Laplace transform rules 


f(t) F(s) Page 
Definition of the Laplace transform 
1. f(t) F() =f, e-* fat 111 
Linearity 
2. aft) +arfrt) a, Fi (8) + dy Fy(s) 114 
Dilation principle 
3. f(at) “F (-) 122 
First Translation principle 
4. e” f(t) F(s —a) 120 
Input derivative principle: first order 
5. f'() sF(s) — f(0) 115 
Input derivative principle: second order 
6 f(t) s?F(s)—sf(0) — f’) 115 
Input derivative principle: nth order 
7. f™OW s"F(s) — s"'f(0) — s"-? 700) — 116 


sees f"—I(0) — fE-YVO) 


Transform derivative principle: first order 


8. tf(t) —F'(s) 121 
Transform derivative principle: second order 

9. t? f(t) F"(s) 

Transform derivative principle: nth order 

10. t” f(t) (—1)" F®(s) 121 
Convolution principle 

11. (f * g)(t) F(s)G(s) 188 


= fj f(t)g(t — 1) de 


Input integral principle 


12. fl foydv =i] 


S 
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Table 2.7 Basic Laplace transforms 


fO FO a 
1 
1 1 - 116 
Ky 
1 
2, t @ 
n! 
3. t" (n=0, 2, 3,...) yer 116 
, T(a+1) 
4 t®” (a>0) ari 118 
1 
5 ett 118 
s—a 
1 
6. t at 
: (s—a)? 
7 Met (n=1,2,3 ) a 119 
»2,3,... (s —ayr+! 
b 
8. sin bt —— 118 
sin 52 + b2 
AY 
9. bt 118 
cos 24+ 
10 e sin bt a a 120 
Mi 8 (s = a) + p2 
11 e” cos bt —-—* __ 120 
. (s _ a)? + p2 


Table 2.8 Heaviside formulas 


f(t) F(s) 

i. rk ert aed rk ent sk 
q'‘(ri) q'(rn) (=r (s— 7) 
q(s) = (s—r)+++(s — 1) Pipes rn, distinct 

5 ett 4 et l 

“  a-b b-a (s — a)(s — b) 

; ae " bebt s 

“ a—b  b-a (s — a)(s — b) 

4 e# " et 4 ef 1 
(a—b)(a—c) (b-a)j(b—-c)  (c—a)(c—b) (s —a)(s — b)(s —c) 

5 ae’ bel! ce! Ss 


(a — b)(a—c) (b —a)(b—c) (c —a)(c —b) (s —a)(s — b)(s —c) 


(continued) 
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Table 2.8 (continued) 


6. 


azett bet 2 tt 


@—b)@—c) G-ab—a * C—aye 


k k\ pep pris 
baer (Jae om) a 
at 


te’ 


(1 + at)e“ 


(s —a)(s — b)(s —c) 


sk 


(s—a)" 
1 

(s — a)? 
s 

(s — a)? 
1 

(s —a)3 
s 


(s —a)3 
2 


AY 


(s —a)3 


In each case, a, b, and c are distinct. See Page 165. 


Table 2.9 Laplace transforms involving irreducible quadratics 


f(t) 


sin bt 


1 
ap (sin bt — bt cos bt) 
1 


apt (G — (bt)?) sin bt — 3bt cos bt) 


1 
48h ( 
cos bt 


1 F 
apt sin bt 
1 
opt (bt sin bt — (bt) cos bt) 


5 ((3bt — (bt)?) sin bt — 3(bt)? cos bt) 


48b° 


Table 2.10 Reduction of order formulas 


(15 — 6(br)*) sin bt — (15bt — (bt)3) cos bt) 


2k —1 


fo 1 _ ot — s 
(s2 + b2)k+1 ~ Ikp2 (s2 + b2)k 


cl s = bel 1 
(s2 + b2)k+1 ~ 9k (s2 + b2)k 


2k b? 


a | 1 
(s? + b2)k 


| 


See Page 155. 
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Table 2.11 Basic convolutions 


f(t) g(t) 
1. f(t) g(t) 
2: 1 g(t) 
3. t% t” 
4. t sinat 
5. la sinat 
6. t cos at 
a t? cos at 
8 t ev 
9 0? e 
10 ef elt 
11 et et 
12 ett sin bt 
13. et cos bt 
14. sin at sin bt 
15: sin at sin at 
16. sin at cos bt 
17. sin at cos at 
18. cos at cos bt 
19. cos at cos at 
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(f * g)(t) 
f * g(t) = fy fgt — u) du 
ie g(t) dr 


min! putatl 
(m+n-+1)! 


at — sinat 


2 
— (at — sinat) 
a 


e” — (1 + at) 


a2 


(ec —e") axXb 


b-—a 
tet 
1 : 
T4 hp (be“ — bcos bt —asinbt) 
a 
1 
papa —acosbt + bsinbt) 
a 


1 
Frags O sinat — asin bt) a#b 
—a 
1 
3g sinat —atcosat) 
a 
Fra ga 4 cosat — acos bt) a#b 
—a 
I. 
=tsinat 
2 


1 
Dupe sinat—bsinbt) a¥#b 
qo 


1 
—(at cosat + sinat) 
2a 


Page 
187 


190 


193 


192, 


192, 


195 


195 


195 


195 


195 


195 


195 
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Chapter 3 
Second Order Constant Coefficient Linear 
Differential Equations 


This chapter begins our study of second order linear differential equations, which 
are equations of the form 


a(t)y" + b(t)y’+cy = fO, (1) 


where a(t), b(t), c(t), called the coefficient functions, and f(t), known as the 
forcing function, are all defined on a common interval J. Equation (1) is frequently 
made into an initial value problem by imposing initial conditions: y(to) = yo and 
y'(to) = yi, where fo € J. Many problems in mathematics, engineering, and the 
sciences may be modeled by (1) so it is important to have techniques to solve these 
equations and to analyze the resulting solutions. This chapter will be devoted to 
the simplest version of (1), namely the case where the coefficient functions are 
constant. In Chap. 2, we introduced the Laplace transform method that codifies in 
a single procedure a solution method for (1), in the case where f € € and initial 
values y(0) and y’(0) are given. However, it will be our approach going forward 
to first find the general solution to (1), without regard to initial conditions. When 
initial conditions are given, they determine a single function in the general solution 
set. The Laplace transform will still play a central role in most all that we do. 

We wish to point out that our development of the Laplace transform thus far 
allows us to easily handle nth order constant coefficient linear differential equations 
for arbitrary n. Nevertheless, we will restrict our attention in this chapter to the 
second order case, which is the most important case for applications. Understanding 
this case well will provide an easy transition to the more general case to be studied 
in Chap. 4. 
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3.1 Notation, Definitions, and Some Basic Results 


For the remainder of this chapter, we will assume that the coefficient functions in 
(1) are constant. Thus, our focus will be the equation 


ay” + by'+cy = f(t), (1) 


where a, b, and c are real numbers and the forcing function /(¢) is a continuous 
function on an interval J. We assume the leading coefficient a is nonzero, otherwise 
(1) is first order. Equation (1) is called a second order constant coefficient linear 
differential equation. 

The left-hand side of (1) is made up of a combination of differentiations and 
multiplications by constants. To be specific and to introduce useful notation, let D 
denote the derivative operator: D(y) = y’. Ina similar way, let D? denote the 
second derivative operator: D?(y) = D(Dy) = Dy’ = y". If 


L=aD’?+bD+c, (2) 


where a, b, and c are the same constants given in (1), then 
L(y) = ay" + by’ +cy. 


We call L a (second order) constant coefficient linear differential operator. 
Another useful way to describe L is in terms of the polynomial q(s) = as?++bs +c: 
L is obtained from g by substituting D for s. We will write L = qg(D). For this 
reason, L is also called a polynomial differential operator. Equation (1) can now 
be rewritten 


Liyy=f or q(Dy=fh 


The polynomial q is referred to as the characteristic polynomial of L and will play 
a fundamental role in determining the solution set to (1). 

The operator L can be thought of as taking a function y that has at least 2 
continuous derivatives and producing a continuous function. 


Example 1. Suppose L = D? — 4D + 3. Find 
Lite’), L(e’), and L(e*). 
> Solution. 
* Lite!) = D2(te') — 4D (te') + 3(te’) 
= D(e' + te’) —4(e' + te’) + 3te’ 


= 2e' + te’ — 4e’ — 4 te!’ 4+ 3te! 
= —2e’. 
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© L(e!) = De) — 4D(e') + 3(e) 
=e! — 4e! + 3e! 
= 0. 


© L(e*) = D’(e*) — 4D(e*) + 3(e*) 
= 9e% — 12e% + 3e% 
= 0. < 


The adjective “linear” describes an important property that LZ satisfies. To explain 
this, let us start with the familiar derivative operator D. One learns early on in 
calculus the following two properties: 


1. If y; and y» are continuously differentiable functions, then 


D(y1 + y2) = D(y1) + D(y2). 


2. If y is acontinuously differentiable function and c is a scalar, then 
D(cy) = cD(y). 


Simply put, D preserves addition and scalar multiplication of functions. When an 
operation on functions satisfies these two properties, we call it linear. The second 
derivative operator D? is also linear: 


D?(y, + y2) = D(Dy, + Dy2) = D’y, + D’y2 


D*(cy) = D(D(cy)) = DcDy =cD’y. 


It is easy to verify that sums and scalar products of linear operators are also linear 
operators, which means that any polynomial differential operator is linear. This is 
formalized in the following result. 


Proposition 2. The operator 
L=aD’?+bD+c 


is linear. Specifically, 


1. If y, and yz have sufficiently many derivatives, then 


L(y + y2) = L(y) + La). 


2. If y has sufficiently many derivatives and c is a scalar, then 


L(cy) = cL(y). 
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Proof. Suppose y, y1, and yz are 2-times differentiable functions and c is a scalar. 
Then 

aD*(y; + y2) + bD(y1 + y2) + e(Y1 + Ya) 

= a(D*y; + D’y2) + b(Dyi + Dy2) + c(y1 + ya) 

= aD*y, +bDy, + cy, +aD*y. + bDy2 + cyr 

Ly, + Lyo. 


II 


L(y1 + ya) 


Thus L preserves addition. In a similar way, L preserves scalar multiplication and 
hence is linear. Oo 


To illustrate the power of linearity, consider the following example. 


Example 3. Let L = D* — 4D + 3. Use linearity to determine 
L(Be! + 4te’ + Se”). 


> Solution. Recall from Example | that 


° L(e')=0. 
° L(te') = —2e'. 
° L(e*)=0. 


Using linearity, we obtain 


L(3e! + 4te’ + Se”) = 3L(e') + 4L (te’) + 5L(e*) 
3-04+4-(—2e') +5-0 


= —8e'. < 


Solutions 


An important consequence of linearity is that the set of all solutions to (1) has a 
particularly simple structure. We begin the description of that structure with the 
special case where the forcing function is identically zero. In this case, (1) becomes 


L(y) =0 (3) 


and we refer to such an equation as homogeneous. 


Proposition 4. Suppose L is a linear differential operator. Then the solution set 
to Ly = Ois a linear space. Specifically, suppose y, yi, and y2 are solutions to 
Ly = 0Oandk isascalar. Then y, + y2 and ky are solutions to Ly = 0. 
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Proof. By Proposition 2, we have 


L(y, +92) = L(v1) + LO2) =0+0=0 
L(ky) =kL(y) =k-0=0. 


These equations show that the solution set is closed under addition and scalar 
multiplication and hence is a linear space. Oo 


Example 5. Use Example | to find as many solutions as possible to the homoge- 
neous equation L y = 0, where 


L = D?—4D +3. 


> Solution. In Example 1, we found that L(e’) = 0 and L(e*’) = 0. Now using 
Proposition 4, we have 


ce’ + Coe* 
is a solution to Ly = 0, for all scalars c, and cz. In other words, 
L(cye! + coe) = 0, 


for all scalars c; and cy. We will later show that all of the solutions to Ly = 0 are 
of this form. | 


It is hard to overemphasize the importance of Proposition 4, since it indicates that 
once a few specific solutions to L(y) = 0 are known, then all linear combinations 
are likewise solutions. This gives a strategy for describing all solutions to L(y) = 0 
provided we can find a few distinguished solutions. The linearity proposition will 
also allow for a useful way to describe all solutions to the general differential 
equation L(y) = f(t) by reducing it to the homogeneous differential equation 
L(y) = 0, which we refer to as the associated homogeneous differential equation. 
The following theorem describes this relationship. 


Theorem 6. Suppose L is a linear differential operator and f is a continuous 
function. If yp is a fixed particular solution to L(y) = f and yy is any solution 
to the associated homogeneous differential equation L(y) = 0, then 


Yp + Yh 
is a solution to L(y) = f. Furthermore, any solution y to L(y) = f has the form 


Y= Yp + Yn- 


Proof. Suppose yp satisfies L(yp) = f and yp satisfies L(yp) = 0. Then by 
linearity, 


L(yp + yn) = LOY) + LOn) = f +0= f 
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Thus y, + yp is a solution to L(y) = /f. On the other hand, suppose y(t) is any 
solution to L(y) = f. Let y, = y — yp. Then, again by linearity, 


L(yn) = L(y — yp) = LY) -LO,) = f — f = 09. 


Thus, yp(¢) is a solution to L(y) = 0 and y = yp + yn. Oo 


This theorem actually provides an effective strategy for describing the solution 
set to a second order linear constant coefficient differential equation, which we for- 
malize in the following algorithm. By an abuse of language, we will sometimes refer 
to solutions of the associated homogeneous equation L(y) = 0 as homogeneous 
solutions. 


Algorithm 7. The general solution to a linear differential equation 


L(y) = f() 


can be found as follows: 


Solution Method for Second Order Linear Equations 


1. Find all the solutions y, to the associated homogeneous differential 
equation Ly = 0. 

2. Find one particular solution y, to L(y) = f. 

3. Add the particular solution to the homogeneous solutions: 


Yp + Yn: 


AS yy Varies over all homogeneous solutions, we obtain all solutions to 


Liy=f 


Example 8. Use Algorithm 7 to solve 
y” —4y’ + 3y = —2e’. 


> Solution. The left-hand side can be written L(y), where LZ is the linear 
differential operator 


L = D?—4D +3. 


From Example 5, we found that 


ya(t) = cre’ + cre*, 
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where c), C2 € R, are all the solutions to the associated homogeneous equation 
L(y) = 0. By Example 1, a particular solution to L(y) = —2e' is yp(t) = te’. By 
Theorem 6, we have 

yp(t) + yn(t) = te’ + cre’ + cre* 
is a solution to L(y) = 2e’, for all scalars c; and co. <4 


The strategy outlined in Algorithm 7 is the strategy we will follow. Section 3.3 
will be devoted to determining solutions to the associated homogeneous differential 
equation. Sections 3.4 and 3.5 will show effective methods for finding a particular 
solution when the forcing function f(t) € E is an exponential polynomial. A more 
general method is found in Sect. 5.6. 


Initial Value Problems 


Suppose L is a constant coefficient linear differential operator, f(t) is a function 
defined on an interval J, and tf) € J. To the equation 


LO) =f 


we can associate initial conditions of the form 


y(to.) = yo, and y'(t) = yi. 


The differential equation L(y) = /, together with the initial conditions, is called 
an initial value problem, just as in the case of first order differential equations. 
After finding the general solution to L(y) = f/f, the initial conditions are used to 
determine specific values for the arbitrary constants that parameterize the solution 
set. Here is an example. 


Example 9. Use Example 8 to find the solution to the following initial value 
problem 
L(y) =—2e', (0) = 1, y'(0) = -2, 


where L = D? — 4D +3. 
> Solution. In Example 8, we verified that 


y(t) = te’ + cye’ + cne*, 


is a solution to L(y) = —2e' for every c1, cz € R. Observe that y’(t) = e' + te’ + 
ce’ + 3c.e*". Setting t = 0 in both y(t) and y’(t) gives 


l= y0)=c) +e) 
—2 = y'(0) =1+¢; + 3ep. 
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Solving these equations gives c} = 3, and c, = —2. Thus, y(t) = te’ +3e! —2e* is 
a solution to the given initial value problem. The existence and uniqueness theorem 
given below implies it is the only solution. < 


Initial Values Not Based at the Origin 


You may have noticed that the initial conditions in the examples given in Chap. 2 and 
in Example 9 above are given at fo = 0. If the initial conditions are given elsewhere, 
then a simple translation can be used to shift the initial conditions back to the origin 
as follows. Suppose f is a function defined on an interval [a, b], to € [a, b], and the 
initial conditions are given by y(to) = yo and y’(to) = y,. Let g(t) = f(t + to) 
and w(t) = y(t +f). Then w(t) = y’(t +f) and w’(t) = y”(¢ + fo). The initial 
value problem given by (1) in y becomes 


aw" + bw’ +cw= ge, 


with initial conditions w(0) = y(to) = yo and w’(0) = y’(to) = yi. We now solve 
for w; it has initial conditions at 0. The function y(t) = w(t — fo) will then be the 
solution to the original initial value problem on the interval [a, b). Thus, it is not 
restrictive to give examples and base our results for initial values at fp = 0. 


The Existence and Uniqueness Theorem 


The existence and uniqueness theorem, as expressed by Corollary 8 of Sect. 1.4, 
for first order linear differential equations has an extension for second order linear 
differential equations. Its proof will be given in Chap. 9 in a much broader setting. 


Theorem 10 (The Existence and Uniqueness Theorem). Suppose f(t) is a 
continuous real-valued function on an interval I. Let ty € I. Then there is a unique 
real-valued function y defined on I satisfying 


ay” +by’+cy = f(t), (4) 


with initial conditions y(to) = yo and y'(to) = y1. If f(t) is of exponential type, so 
are the solution y(t) and its derivatives y'(t) and y" (t). Furthermore, if f(t) is in 
E, then y(t) is also in E. 


You will notice that the kind of solution we obtain depends on the kind of forcing 
function. In particular, when the forcing function is an exponential polynomial, then 
so is the solution. This theorem thus provides the basis for applying the Laplace 
transform method. Specifically, when the Laplace transform is applied to both sides 
of (4), we presumed in previous examples that the solution y and its first and second 
derivative have Laplace transforms. The existence and uniqueness theorem thus 
justifies the Laplace transform method when the forcing function is of exponential 
type or, more specifically, an exponential polynomial. 
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Exercises 


1-10. Determine which of the following are second order constant coefficient linear 
differential equations. In those cases where it is, write the equation in the form 
L(y) = f(t), give the characteristic polynomial, and state whether the equation is 
homogeneous. 


. y”—yy' =6 
_y"—3y =e 

; y"+y'+4y =0 

. y” +sin(y) = 0 
ty’+y=Int 

yy +2y'+3y =e7 
. y” —Ty' + 10y =0 
.y+8y=t 

. yy’ +2=cost 

10. 2y”—12y’+ 18y =0 


CIADNWAARWNE 


\o 


11-14. For the linear operator L, determine L(y). 
ll. L= D?+3D+2. 


(a) y=e’ 

(b) y=e™ 

(c) y=sint 
12, L = D?-2D +1. 

(a) y = 4e! 

(b) y =cost 

(©) y=—e% 
13.L =D? +1. 

(a) y = —4sint 

(b) y = 3cost 

(cc) y=l 


14.L = D*-4D +8. 


(a) y =e” 
(b) y =e” sin 2r 
(c) y = e* cos2t 


15. Suppose L is a polynomial differential operator of order 2 and 


¢ L(cos2t) = 10sin2t 
« Lie’) =0 
° L(e*") =0. 


Use this information to find other solutions to L(y) = 10 sin 2t. 
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16. Suppose L is a polynomial differential operator of order 2 and 


° L(te*) = 5e* 
+ Le) =0 
° L(e*) =0. 


Use this information to find other solutions to L(y) = 5e*’. 
17. Let L be as in Exercise 15. Use the results there to solve the initial value 


problem 
L(y) = 10sin2r, 


where y(0) = | and y’(0) = —3. 
18. Let L be as in Exercise 16. Use the results there to solve the initial value 


problem 
L(y) = 5e*, 


where y(0) = —1 and y’(0) = 8. 

19. If L = aD? + bD +c where a, b, c are real numbers, then show that 
L(e") = (ar? + br + c)e”. That is, the effect of applying the operator L 
to the exponential function e” is to multiply e” by the number ar? + br +c. 


20-21. Use the existence and uniqueness theorem to establish the following. 
20. Suppose ¢(f) is a solution to 
y"” +ay'+by =0, 


where a and b are real constants. Show that if the graph of ¢ is tangent to the 
t-axis, then d = 0. 


21. More generally, suppose ¢; and ¢2 are solutions to 


y” +ay'’+by=f, 
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where a and b are real constants and f is a continuous function on an interval 
I. Show that if the graphs of ¢; and ¢2 are tangent at some point, then ¢, = @p. 


PT PB 
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3.2 Linear Independence 


In Sects. 2.6 and 2.7, we introduced B,, for any polynomial q, and referred to it as 
the standard basis of the linear space €,. For a linear space, F, of functions defined 
on an interval 7, a basis of F is a subset 6 that satisfies two properties: 


1. Span B = F. 
2. Bis linearly independent. 


The notion of a spanning set was developed in Sect. 2.6 where we showed that B, 
spanned the linear space €,. It is the purpose of this section to explain the notion 
of linear independence and consider some of its consequences. We will then show 
that B, is linearly independent, thus justifying that B, is a basis of €, in the precise 
sense given above. 

A set of functions { f1,..., f,}, defined on some interval J, is said to be linearly 
independent if the equation 


afi t-+an fr =0 (1) 


implies that all the coefficients a),...,d, are zero. Otherwise, we say that 
{fi,..., fn} is linearly dependent.' 

One must be careful about this definition. We do not try to solve equation (1) for 
the variable ¢. Rather, we are given that this equation is valid for all tf € 7. With 
this information, the focus is on what this says about the coefficients a1,..., day): are 
they all necessarily zero or not. 

We illustrate the definition with a very simple example. 


Example 1. Show that the set {e’, e~’} defined on R is linearly independent. 


> Solution. Consider the equation 
aye’ + ane’ = 0, (2) 
for all t € R. In order to conclude linear independence, we need to show that a, 


and a2 are zero. There are many ways this can be done. Below we show three 
approaches. Of course, only one is necessary. 


Method 1: Evaluation at Specified Points 


Let us evaluate (2) at two points: t = 0 andt = 1: 


'A grammatical note: We say f\,..., Jn are linearly independent (dependent) if the set 
{fi...-, fn} is linearly independent (dependent). 
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t=0, a, +a2 = 0, 
t=1, a,(e) + ao(1/e) = 0. 


Multiply the first equation by e and subtract the result from the second equation. We 
get a2((1/e) — e) = 0. So ay = 0 and this in turn gives a; = 0. Thus, {e’,e~"} is 
linearly independent. 


Method 2: Differentiation 


Take the derivative of (2) to get aye’ — ane! 


derivative at t = 0 gives 


= 0. Evaluating equation (2) and the 


a, +a, = 0, 
ay —a, = 0. 


The only solution to these equations is a; = 0 and a, = O. Hence, {e’,e~"} 
is linearly independent. (This method will be discussed more generally when we 
introduce the Wronskian below.) 


Method 3: The Laplace Transform 


Here we take the Laplace transform of (2) to get 


a} ag 
s=1 °° s4+i1— 


’ 


which is an equation valid for all s > 1 (since the Laplace transform of e’ is valid for 
s > 1). However, as an equation of rational functions, Corollary 7 of Appendix A.2 
implies equality for all s 4 1,—1. Now consider the limit as s approaches 1. If 


a is not zero, then rari has an infinite limit while the second term ra has a finite 
limit. But this cannot be as the sum is 0. It must be that aj = O and therefore 


a2 


sz7 = 0. This equation in turn implies a7 = 0. Now it follows that {e’,e"} is 
linearly independent. (This method is a little more complicated than Methods | and 
2 but will be the method we use to prove B, is linearly independent.) < 


Remark 2. Let us point out that when we are asked to determine whether a set 
of two functions {f\, /2} is linearly dependent, it is enough to see that they are 
multiples of each other. For if { f1, {2} is linearly dependent, then there are constants 
c; and ¢, not both zero, such that c; fj + c2.f2 = 0. By renumbering the functions 
if necessary, we may assume c; # 0. Then fj = = Hence, fi and fo are 
multiples of each other. On the other hand, if one is a multiple of the other, that is, 
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if f, = mf, then f, — mf) = 0 and this implies linear dependence. Thus, it is 
immediate that e’ and e~ are linearly independent since they are not multiples of 
each other. 


Example 3. Show that the set {e’, cost, sint} is linearly independent. 


> Solution. We will use method 3 to show linear independence. Suppose a;e" + 
a7 cost + a3sint = 0. Take the Laplace transform to get 


ay aos +43 
+ 
s—l1 s?+1 


’ 


valid for all s 4 1,7, —i, by Corollary 7 of Appendix A.2. Now consider the limit as 
s approaches 1. If a; 0, then the first term becomes infinite while the second term 
is finite. Since the sum is 0, this is impossible so a; = 0. Thus “3-3 = 0. Now 
consider the limit as s approaches 7. If either a or a3 is nonzero, then the quotient 
becomes infinite which cannot be. Thus we have a2 = a3 = 0. It now follows that 
{e’, cost, sin t} is linearly independent. < 


Let us consider an example of a set that is not linearly independent. 
Example 4. Show that the set {e’,e~’, e’ + e~"} is linearly dependent. 


> Solution. To show that a set is linearly dependent, we need only show that we 
can find a linear combination that adds up to 0 with coefficients not all zero. One 
such is 

(1)je’ + (Le + (-1)(e' +") = O. 


The coefficients, highlighted by the parentheses, are 1,1, and —1 and are not all 
zero. Thus, {e’,e’, e’ + e~'} is linearly dependent. The dependency is clearly seen 
in that the third function is the sum of the first two. | 


This example illustrates the following more general theorem. 


Theorem 5. A set of functions { f\,..., fr} is linearly dependent if and only if one 
of the functions is a linear combination of the others. 


Proof. Let us assume that one of the functions, f; say, is a linear combination of the 
other functions. Then we can write fj = a2 fo +--+ + dy fn, which is equivalent to 


fi — a2 fo — 43 fy —+++— Gn fn = 0. 


Since not all of the coefficients are zero (the coefficient of f; is 1), it follows 
that {f1,..., f,} is linearly dependent. On the other hand, suppose { fi,..., fr} 
is linearly dependent. Then there are scalars, not all zero, such that a; f, +---+ dy, 
Jn = 9. By reordering if necessary, we may assume that a; 4 0. Now we can solve 
for f, to get 


a{ at 


Thus, one of the functions is a linear combination of the others. oO 
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Solving Equations Involving Linear Combinations 


Linear independence is precisely the requirement we need to be able to solve for 
coefficients involving a linear combination of functions. Consider the following 
example: 


Example 6. Suppose we are given the following equation: 
(c, + Ae’ — (co + De = 3e’ — 4cye™, 


valid for all t € R. Determine c; and cp. 


> Solution. Subtracting the right side from both sides gives 
(c, + le’ + (4c) —c2 — le = 0. (3) 


In Example 1, we showed that {e’, e~'} is linear independent. Thus, we can now say 
that the coefficients in (3) are zero, giving us 


cy + 1=0 
4c) -@ —1=0 
Solving these equations simultaneously gives c; = —1 and cz = —5. < 


Notice that the equations obtained by setting the coefficients equal to zero in (3) are 
the same as equating corresponding coefficients in the original equations: c; +4 = 3 
and —(cz + 1) = —4c. More generally, we have the following theorem: 


Theorem 7. Suppose { f,..., fy} is a linearly independent set. If 
ahi ete + dn Sn = bi fi nee + ba fn 


then a, = Db, az = bo, sey Ayn = bn. 


Proof. The given equation implies 
(a1 —bi) fi +++ + Gn —bn) fn = 9. 


Linear independence implies that the coefficients are zero. Thus, a; = by, a2 = bo, 
ey An = Dy. oO 
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The Linear Independence of B, 


Let q(s) = s?—1 = (s—1)(s +1). Then B, = {e', e~'}. In Example 2, we showed 
that B, is linearly independent and used that fact in Example 6. In like manner, if 
q(s) = (s — 1)(s? + 1), then B, = {e', cost, sint}, and we showed in Example 3 
that it too was linearly independent. The following theorem establishes the linear 
independence of B, for any polynomial g. The method of proof is based on Method 
3 in Example 2 and can be found in Appendix A.3. 


Theorem 8. Let g be a nonconstant polynomial. View By as a set of functions on 
I = [0, 00). Then B, is linearly independent. 


One useful fact about linearly independent sets is that any subset is also linearly 
independent. Specifically, 


Theorem 9. Suppose S is a finite set of functions on an interval I which is linearly 
independent. Then any subset of S is also linearly independent. 


Proof. Suppose S = {f1,..., fr} is linearly independent and suppose S, is a subset 


of S. We may assume by reordering if necessary that S. = {fi,..., fc}, for some 
k <n. Suppose c; fj + ---cx f_ = 0 for some constants cy,...,cx. Let ch41. = 
+++ = Cy, = 0. Then c, fi +---Cy fy, = 0. Since S is linearly independent, c,..., Cy 
are all zero. It follows that S, is linearly independent. oO 


Since B, is linearly independent, it follows from Theorem 9 that any subset is 
also linearly independent. 


Example 10. Show that the following sets are linearly independent: 

1. {ee fe"} 

2. 1e.8 et 

3. {cosf, sin 2r} 

> Solution. 

1. Let g(s) = (s — 1)(s + 1)(s — 2)”. Then B, = {e',e‘,e%, te} and 
{e! ,e, te! \ C B,. Theorem 9 implies linear independence. 

2. Let g(s) = (s — I(s + I(s — 3)?. Then By = {e’,e*,e%, te*} and 
{ef ,e, te C B,. Linear independence follows from Theorem 9. 


3. Let q(s) = (s* + 1)(s? + 4). Then B, = {cost,sint,cos2r,sin2t} and 
{cos ft, sin 2t} C B,. Linear independence follows from Theorem 9. < 
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Restrictions to Subintervals 


It is important to keep in mind that the common interval of definition of a set of 
functions plays an implicit role in the definition of linear independence. Consider 
the following example. 


Example 11. Let fi(t) = |t| and fo(t) = ¢. Show that { fi, f:} is linearly 
independent if the interval of definition is 7 = R and linearly dependent if 
I = [0, ov). 


> Solution. Suppose the interval of definition is 7 = R. Suppose 


efit) + c2fo(t) = cy |t| + cot = 0. 


Evaluation att = 1 andt = —1 gives 
cy +@a=0 
Ey = 0) 


These equations reduce to c; = 0 and cz = 0. Thus, { fi, fo} is linearly independent 
on J = R. On the other hand, suppose J = [0, 00). Then fi(t) = ¢t = fo(t) (on J). 
Lemma 5 implies { f, {2} is linearly dependent. < 


Admittedly, the previous example is rather special. However, it does teach us 
that we cannot presume that restricting to a smaller interval will preserve linear 
independence. On the other hand, if a set of functions is defined on an interval [ 
and linearly independent when restricted to a subset of J, then the set of functions 
is linearly independent on /. For example, Theorem 8 says that the set B, is linearly 
independent on [0, co) yet defined on all of R. Thus, B, is linearly independent as 
functions on R. 


The Wronskian 


Suppose fi,...,f, are functions on an interval J with n — 1 derivatives. The 
Wronskian of f\,..., fy is given by 


A@®) ft)... fi 
aan isda) 2 2 


=I =1 7 =I «) 
On Ou 


Clearly, the Wronskian is a function on 7. We sometimes refer to the n x n matrix 
given above as the Wronskian matrix and denote it by W(f\,..., f,)(t). 


3.2 Linear Independence 223 


Example 12. Find the Wronskian of the following sets of functions: 
1. {t,1/t} 

2 fe fe! 

3. {e’,et,e’ t+e7} 


> Solution. 


_ fb Aft) at be 
1. w(t, 1/t) = det a = (=F. 


e2! e! 
2. w(e”,e~") = det Be ae) = —e! —2e' = —3e7 
3, 
e ef e+e? 
w(e',e“,e’ +e") =det}e’ -e* e’—e7t 
e& ef e+e? 
=f. is a, 
=e'det| ~ abs 
e’ e+e 
aa t = 
—e’ det 2 . - al 
e e+e 
=E t SE 
te! act | a 2 
—e e' —e 
= e'(—2) —e'(0) + e'(2) = 0. es 
Theorem 13. Suppose fi, fo,..., fy are functions on an interval I with n — 1 
derivatives. Suppose the Wronskian w(f\, fo,..., fn) is nonzero for some to € I. 
Then { fi, fo,.-+, fn} is linearly independent. 
Proof. *Suppose c1,C2,.... Cn ate scalars such that 
afitafat---tafi =0 (4) 
on J. We must show that the coefficients cj,...,C, are zero. Consider the n — 1 


derivatives of (4): 


We assume in this proof some familiarity with matrices and determinants. See Chap. 8 for details. 
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Ci Ji tou + aft = 0 
Cis), + see + taf, = 0 
a A aed oe ey ame = 0 


We can write this system in matrix form as 


W(f.---. fade = 9, 
where W(fi,..., fn) is the m x n Wronskian matrix, 
Cl 0 
= , and 0= : 
Cn 0 
Since w(fi,.--, fn)(to) #4 0, it follows that the Wronskian matrix at fo, 


W(fi,.--; fn) (to), is invertible. Thus, 


c=W'(f,..-, fr)(to)0 = 0. 


This means c),...,¢, are zero and { f|,..., f,} is linearly independent. Oo 


In Example 12, we saw that w(t,1/t) = —2/t? and w(e%,e") = —3e™, 
both nonzero functions. Hence, {t, 1/t} and {e*" oF are linearly independent. A 
frequent mistake in the application of Theorem 13 is to assume the converse is 
true. Specifically, if the Wronskian, w(fi,..., fn), is zero, we may not conclude 
that f\,..., f, are linearly dependent. In Example 12, we saw that w(e’,e',e’ + 
e~') = 0. We cannot conclude from Theorem 13 that {e’,e~’, e’ + e~"} is linearly 
dependent. Nevertheless, linear dependence was shown in Example 4. However, 
Exercises 26 and 27 give a simple example of two linearly independent functions 
with zero Wronskian. If we add an additional assumption to the hypothesis of 
Theorem 13, then the converse will hold. This is the content of Theorem 8 of 
Sect. 3.3 given in the next section for the case n = 2 and, generally, in Theorem 6 
of Sect. 4.2. 

We conclude this section with a summary of techniques that can be used to show 
linear independence or dependence. Suppose S = {f1,..., f,} is a set of functions 
defined on an interval J. 
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To Show that S is Linearly Independent 


. Evaluate a linear combination of S at selected points in J to get a linear 
system. If the solution is trivial, that is, all coefficients are zero, then S is 
linearly independent. 


. Compute the Wronskian, w(/1,..., f,). If it is nonzero, then S is linearly 
independent. 


. If S C B, for some gq, then S is linearly independent. 


To Show that S is Linearly Dependent 
. Show there is a linear relation among the functions /f|,..., f,. That is, 
show that one of the functions is a linear combination of the others. 


. Warning: If the Wronskian, w(/i,..., f,), is zero, you cannot conclude 
that S is linearly dependent. 
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3.2 Linear Independence 227 
Exercises 


1-13. Determine whether the given set of functions is linearly independent or 
linearly dependent. Unless otherwise indicated, assume the interval of definition 
isJ=R. 


{ 

{ 

{In 2t, In5z¢}, on J = (0, 00) 
{In 7?, In >} 
{ 
t 
t 
{ 


cos(t + 7), cos(t — )} 


10. {cos? t, sin’ ft, 1\ 
Il. fe, 1,e} 

12. {e',e’ sin 27} 
13,. {27 17 ef, et} 


14-21. Compute the Wronskian of the following set of functions. 


14, fe*,6™} 

15. {t,t Int}, J = (0,00) 

16. {t cos(3 Int), ¢ sin(3 Inr)}, J = (0,00) 
17, 47" 2} 

18. fee ey 

19. fe" eM, e73"t 

20. {1,t,17} 

22 {1,007 0) 


22-25. Solve the following equations for the unknown coefficients. 


22. (a+ b)cos2t — 3 sin2t = 2cos2t + (a — b) sin 2t 
23. (25c, + 10cz)e** + 25c2te** = 25te* 

24. 3a)t — apt Int} = (a2 + It + (a) —a2)t Int? 

25. ay + 3t — aot? = ay + ait — 30? 
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26-27. In these two problems, we see an example of two linearly independent 
functions with zero Wronskian. 


26. Verify that y(t) = ¢° and y2(t) = |r| are linearly independent on (—oo, oo). 
27. Show that the Wronskian, w(y1, y2)(t) = 0 forallt € R. 
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3.3 Linear Homogeneous Differential Equations 


In this section, we focus on determining the solution set to a homogeneous second 
order constant coefficient linear differential equation. Recall that if g(s) is a 
polynomial, we have defined the linear space €, to be the set of all exponential 
polynomials whose Laplace transform is in R,, that is, can be written with 
denominator q(s). (See Sects.2.6 and 2.7.) Moreover, we have developed a very 
specific description of the space €, by giving what we have called a standard basis 
B, of E, so that 


Span By = €&. 


Lemma 1. Let g(s) = as* + bs +c. If y is a function whose second derivative is 
of exponential type, then 


Liq(D)y} = q(s)£ ty} (5) — p(s), 


where p(s) = ayos + (ay: + byo) is a polynomial of degree 1. 
Proof. If y(t) is of exponential type, then so are y(t) and y’(t) by Lemma 4 
of Sect.2.2. We let £{y(t)} = Y(s) and apply linearity and the input derivative 
principles to get 
Liq(D)y} = L fay" + by’ + cy} 
= al {y"(t)} + bL£ {yO} + cL {yO} 
as’Y(s) — asyy — ay + bsY(s) — byo + cY(s) 


II 


II 


(as? + bs +c) Y(s) — ayos — ay; — byo 
= q(s)Y(s) — p(s), 


where p(s) = ayos + (ay + byo). a 


Theorem 2. Let q(s) be a polynomial of degree 2. Then the solution set to 
q(D)y = 0 


is Eq. 

Proof. The forcing function f(t) = 0 is in €. Thus, by Theorem 10 of Sect. 3.1, 
any solution to q(D)y = 0 is in €. Suppose y is a solution. By Lemma | we have 
Li{q(D)y} (s) = q(s)L£{y}(s) — p(s) = 0 where p(s) is a polynomial of degree at 
most | depending on the initial values y(0) and y’(0). Solving for L{y} gives 


PO) ¢ 


Lty}(s) = 1S 


Ry. 
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This implies y € €,. On the other hand, suppose y € € . Then L{y}(s) = AG} € 
R,q, and by Lemma 1, we have 


LED NO Ht" =H =O ane: 
q(s) 


where p(s) is a polynomial that depends on the initial conditions. Note, however, 
that p(s) — pi(s) is a polynomial in R, the set of proper rational functions, and 
therefore must be identically 0. Thus, £{q(D)y} = 0 and this implies g(D)y = 0 
on [0, 00). Since g(D)y and 0 are exponential polynomials and equal of [0, co), 
they are equal on all of R. It follows that the solution set tog(D)y =Ois€. 


Combining Theorem 2 and the prescription for the standard basis B, given in 
Theorem 4 of Sect. 2.6, we get the following corollary. 


Corollary 3. Suppose q(s) = cs” + cs + Co is a polynomial of degree 2. If 


1. q(s) = co(s — r1)(S — ro), where r, # rz are real, then By = {e", e'"}. 
2. q(s) = c2(s — r)? then B, = {e", te”'}. 
3. q(s) = ((s — a)? +b’), b > 0, then By = {e" cos bt, e sin bt}. 


In each case, the solution set to 
q(D)y =0 
is given by E, = Span By. That is, if By = {yi (t), yo(t)}, then 
Eq = {cer yi(t) + coya(t) : c1,c2 € R}. 


Remark 4. Observe that the solutions to g(D)y = 0 in these three cases may be 
summarized in terms of the roots of g(s) as follows: 


1. If g(s) has distinct real roots r; and rz, then all solutions are given by 
y(t) =cye"™ + ce" : 1,02 ER. 
2. If g(s) has one real root r with multiplicity 2, then all solutions are given by 
y(t) =cye" + cote” : C1, ER. 
3. If g(s) has complex roots a + bi, then all solutions are given by 
y(t) = cye™ cos bt + cpe sinbt : c},c. ER. 


Example 5. Find the general solution to the following differential equations: 


1. y” +3y’+2y =0 
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2. y"+2y’+y=0 
3. y”—6y’+ 10y = 0 
> Solution. 1. The characteristic polynomial for y” + 3y’ + 2y = Ois 


g(s) =s? +38+2=(84+1)(5 +2). 


The roots are —1 and —2. The standard basis for €, is fen ey. Thus, the 


solutions are 


2t 


y(t) =cye’ + oe :c1,0. ER. 


2. The characteristic polynomial of y” + 2y’ + y = Ois 
g(s) =s?+2s+1=(s +1)’, 


which has root s = —1 with multiplicity 2. The standard basis for €, is 
fe, te‘}. The solutions are 


y(t) =cye + ote :c1,0. ER. 
3. The characteristic polynomial for y” — 6y’ + 10y = 0 is 
q(s) = s? -65 +10 = (s—3)P +1. 


From this, we see that the roots of g are 3 + i and 3 — i. The standard basis for 
Eq is te" cost, e* sint}. Thus, the solutions are 


3 


y(t) = cye* cost + cre™ sint : cy,c2 € R. < 


These examples show that it is a relatively easy process to write down the solution 
set to a homogeneous constant coefficient linear differential equation once the 
characteristic polynomial has been factored. We codify the process in the following 
algorithm. 


Algorithm 6. Given a second order constant coefficient linear differential equation 


q(D)y = 0, 


the solution set is determined as follows: 
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Solution Method for 
Second Order Homogeneous Linear Equations 


1. Determine the characteristic polynomial, q(s). 

2. Factor q(s) according to the three possibilities: distinct real roots, a double 
root, complex roots. 

3. Construct B, = {yi(t), y2(t)} as given in Sect. 2.6. 

4. The solutions y(t) are all linear combinations of the functions in the 
standard basis B,. In other words, 


y(t) =c1 y(t) + coyo(t), 


forcy, Co ER. 


Initial Value Problems 


Now suppose initial conditions, y(0) = yo and y’(0) = y, are associated to a 
differential equation g(D)y = 0. To determine the unique solution guaranteed by 
Theorem 10 of Sect.3.1, we first find the general solution in terms of the standard 
basis, B,. Then the undetermined scalars given in the solution can be determined by 
substituting the initial values into y(t) and y’(t). This gives an alternate approach to 
using the Laplace transform method which incorporates the initial conditions from 
the beginning. 


Example 7. Solve the initial value problem 
y" + 2y' + y =0, 


with initial conditions y(0) = 2 and y’(0) = —3. 


> Solution. We first find the general solution. Observe that q(s) = s? + 2s + 
1 = (s + 1)? is the characteristic polynomial for y” + 2y’ + y = 0. Thus, B, = 
{e~’, te~‘} and any solution is of the form y(t) = cje‘ + cote. Observe that 


y(t) = —cje + c2(e — te“). Now evaluate both equations at t = 0 to get 
Cl = 2 
—(y +a = —3, 
which implies that c; = 2 and cp = —1. Thus, the unique solution is 


y(t) = 2e* —te™. < 
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Abel’s Formula 


We conclude this section with a converse to Theorem 13 of Sect. 3.2 in the second 
order case. 


Theorem 8 (Abel’s Formula). Let q(s) = s* +bs +c and suppose f, and fy are 
solutions to q(D)y = 0. Then the Wronskian satisfies 


w(fi, fr) = Ke, (1) 
for some constant K and { f\, f2} is linearly independent if and only if w(fi, f2) is 
nonzero. 


Proof. First observe that since /; is a solution to g(D)y = 0 we have f/’ = —bf/— 
cf, and similarly for /:. To simplify the notation let w = w(fi, 2) = A -AS/: 
Then the product rule gives 


W=fiht+Ah -hA+ AA) 
=fifl - Af! 
= fi(-bf; — cfr) — fa(-bfi — cf) 
= bff - ASD 
= —bw. 


Therefore, w satisfies the differential equation w’ + bw = 0. By Theorem 2 of 
Sect. 1.4, there is a constant K so that 


w(t) = Ke”. 


This gives (1). If K 4 0, then w ¥ 0 and it follows from Theorem 13 of Sect. 3.2 
that { |, /2} is a linearly independent set. 

Now suppose that w = 0. We may assume f| and f> are nonzero functions for 
otherwise it is automatic that { f;, f:} is linearly dependent. Let to be a real number 
where either f| (to) or f2(to) is nonzero and define z(t) = fo(to) fi(t) — fio) fat). 


Then z is a solution to g(D)y = 0 and 
2(to) = fa(to) filto) — filto) fr(to) = 0 
Z(to) = Aalto) A (to) — Ato) 2 (to) = 9. 
The second line is obtained because w = 0. By the uniqueness and existence 


theorem, Theorem 10 of Sect. 3.1, it follows that z(t) = 0. This implies that { fi, fo} 
is linearly dependent. Oo 
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Remark 9. Notice that we require the leading coefficient of g(s) be one. If g(s) = 
as* + bs + c, then the Wronskian is a multiple of ea, Equation (1) is known 
as Abel’s formula. Notice that the Wronskian is never zero or identically zero, 
depending on K. This will persist in the generalizations that you will see later. 
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Exercises 


1-12. Determine the solution set to the following homogeneous differential equa- 
tions. Write your answer as a linear combination of functions from the standard 
basis. 


1. y’—y’-2y=0 

2. y’+y'—-12y =0 
3. y” + 10y’ + 24y = 0 
4. y”—4y’-12y =0 
5. y” + 8y’ + l6y =0 
6. y” —3y’—-10y = 0 
7. y" + 2y' + Sy =0 
8. 2y” —12y’ + 18y =0 
9. y” + 13y’ + 36y =0 
10. y” + 8y’ + 25y = 0 
Il. y” + 10y’ + 25y = 0 
12. y” —4y’—21ly =0 


13-16. Solve the following initial value problems. 


13. y’-y=0, y(0)=0,y'0)=1 

14. y”—3y’-10y =0, y(0)=5, y’(0) =4 
15. y”—10y’ + 25y =0, y(0)=0, y’(0) = 1 
16. y” + 4y’ + 13y =0, y(0)=1, y’(0) = —5 


17-22. Determine a polynomial g so that B, is the given set of functions. Compute 
the Wronskian and determine the constant K in Abel’s formula. 


17. 4e" 6°} 

18. ferl!, eM 

19. {e*, te*} 

20. fe’, te’) 

21. {e' cos 2t, e' sin 2r} 
22. {e" cos bt, e” sin bt} 
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3.4 The Method of Undetermined Coefficients 


In this section (and the next), we address the second part of Algorithm 7 of Sect. 3.3, 
namely, finding a particular solution to 


q(D)y = f(t). (1) 


We will assume the characteristic polynomial qg(s) has degree 2. If we assume, 
f(t) € € then the existence and uniqueness theorem, Theorem 10 of Sect.3.1, 
implies that a solution y(t) = yp(f) to (1) is in €. Therefore, the form of y,(t) is 


yp(t) = aryi(t) +++ + anyn(0), 


where each y;(t), fori = 1,...n, is a simple exponential polynomial and the 
coefficients a),...,@, are to be determined. We call yp a test function. The method 
of undetermined coefficients can be broken into two parts. First, determine which 
simple exponential polynomials, y,(t),...,yn(¢), will arise in a test function. 
Second, determine the coefficients, a1, ..., dy. 

Before giving the general procedure let us consider the essence of the method in 
a simple example. 


Example 1. Find the general solution to 
y” = y’ = 6y = e!. (2) 


> Solution. Let us begin by finding the solution set to the associated homogeneous 
equation 
y=) —by =o, (3) 


Observe that the characteristic polynomial is g(s) = s* — s — 6 = (s — 3)(s + 2). 
Thus, B, = {e* ,e 2 and a homogeneous solution is of the form 


yn = c1e™ + coe", (4) 


Let us now find a particular solution to y” — y’ — 6y = e. Since any particular 
solution will do, consider the case where y(0) = 0 and y’(0) = 0. Since f(t) = 
e’ € &, we conclude by the uniqueness and existence theorem, Theorem 10 of 
Sect.3.1, that the solution y(t) is in €. We apply the Laplace transform to both 
sides of (2) and use Lemma | of Sect. 3.3 to get 


1 
q(s)L£{y(t)} (s) = FL, 
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Solving for £ {y(t)} gives 


1 


ENON) = ee GEIL) 


It follows that y(t) € €(s+1)(s—3)(942). It is easy to see that Bis+41)(s—3)(s+2) = 
{fe*, et, a Thus, 


y(t) = aye! + age* + a3e", 


2 


for some a1, a7, and a3. Observe now that a,e*’ +a3e~”" is a homogeneous solution. 


This means then that the leftover piece 


Yp(t) = aye 
is a particular solution for some a; € R. This is the test function. Let us now 
determine a, by plugging y,(t) into the differential equation. First, observe that 
y(t) = —a,e! and yp (t) = a\e‘. Thus, (3) gives 

e' = yp — Vp — 6Yp 


=a,e' +a;e' —6aje" 


= —4a,e™. 
From this we conclude | = —4a,; or a; = —1/4. Therefore, 
=e 
yp(t) = —e : 


4 


is a particular solution and the general solution is obtained by adding the homoge- 
neous solution to it. Thus, the functions 


=| 
y(t) = yp(t) + yn) = ta + cye*® + e,e 1, 


where c; and cz are real numbers, make up the set of all solutions. < 


Remark 2. Let v(s) = (s + 1) be the denominator of £ {e~}. Then v(s)q(s) = 
(s + 1)(s — 3)(s + 2), and the standard basis for Ey, is re) et eas The 
standard basis for €, is eg : oh Observe that the test function yp(t) is made 
up of functions from the standard basis of €,, that are not in the standard basis of 
€,. This will always happen. The general argument is in the proof of the following 
theorem. 


Theorem 3. Suppose L = q(D) is a polynomial differential operator and f € E. 
If L{f} = u/v, and By, is the standard basis for €,, then there is a particular 
solution yp(t) to 


L(y) = f() 


which is a linear combination of terms that are in By, but not in Bg. 
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Proof. By Theorem 10 of Sect. 3.1, any solution to L(y) = f(f) is in €, and hence, 
it and its derivatives have Laplace transforms. Thus, 


£tq(D)y} = Lif} = © 
v(s) 
=> q(s)£L{y} -— p(s) = “ by Lemma | of Sect. 3.3 


Ps) u(s)  __ us) + pOs)v(s)_ 


= POPS Gs ae) © AGG) 


It follows that y(t) is in €,, and hence a linear combination of terms in B,,. Since 
By C Byy, we can write y(t) = yn(t) + yp(t), where yp(¢) is a linear combination 
of terms in B, and yp)(f) is a linear combination of terms in B,, but not in By. Since 
Yn(t) is a homogeneous solution, it follows that y(t) = y(t) — yn(£) is a particular 
solution of L(y) = f(t) of the required form. Oo 


Theorem 3 is the basis for the following algorithm. 


Algorithm 4. A general solution to a second order constant coefficient differential 
equation 


q(D)(y) = FM) 


can be found by the following method. 


The Method of Undetermined Coefficients 


1. Compute the standard basis, B,, for €,. 

2. Determine the denominator v so that £{f} = u/v. This means that 
T(t) € &,. 

3. Compute the standard basis, B,,, for Eyg. 

4. The test function, yp(t), is the linear combination with arbitrary coeffi- 
cients of functions in 6,, that are not in By. 

5. The coefficients in yp(t) are determined by plugging y(t) into the 
differential equation g(D)(y) = f(t). 

6. The general solution is given by 


y(t) = yp(t) + ya), 


where y,(¢) is an arbitrary function in €. 


Example 5. Find the general solution to y” — 5y’ + 6y = 4e”". 
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> Solution. The characteristic polynomial is 
q(s) = s* —5s + 6 = (s — 2)(s —3) 


and the standard basis for €, is By = {e7!, e*}. Since L {4e7"} = 4/(s — 2), we 
have v(s) = s — 2 so v(s)q(s) = (s — 2)?(s — 3) and the standard basis for Ey, is 
Byg = {e , te? eX }. The only function in B,, that is not in By is te’. Therefore, 
our test function is yp(t) = a;te”’. A simple calculation gives 


Yp = ayte”* 

y, = aye" + 2a,te” 

DA = dae" + date’. 
Substitution into y” — 5y’ + 6y = 4e”' gives 


4e% = yl — Sy! + 6yp 


(4a,e" + 4a;te”’) — 5(aye* + 2a;te”’) + 6(a;te”’) 
2t 


= —ajye 
From this, it follows that aj = —4 and yp = —4te~'. The general solution is thus 
given by 
y(t) = yp(t) + yn(t) = —Ate* + ce + me”, 
where c; and cp are arbitrary real constants. < 


Remark 6. Based on Example |, one might have expected that the test function in 
Example 5 would be yp = ce”. But this cannot be since e”’ is a homogeneous 
solution, that is, L(e’) = 0, so it cannot possibly be true that L(a,e~’) = 4e!. 
Observe that v(s) = s —2 and q(s) = (s —2)(s + 3) share a common root, namely, 
s = 2, so that the product has root s = 2 with multiplicity 2. This produces te”! 
in the standard basis for €,, that does not appear in the standard basis for €,. In 
Example 1, all the roots of vg are distinct so this phenomenon does not occur. 
There is thus a qualitative difference between the cases when v(s) and qg(s) have 
common roots and the cases where they do not. However, Algorithm 4 does not 
distinguish this difference. It will always produce a test function that leads to a 
particular solution. 


Example 7. Find the general solution to 
y” —3y' + 2y = 2te’. 
> Solution. The characteristic polynomial is 


q(s) = s* —3s +2 = (s—1)(s—2). 
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Hence, the standard basis for €, is B, = {e’ ,e ie The Laplace transform of 2te’ 
is 2/(s — 1)? so v(s) = (s — 1)’, and thus, v(s)g(s) = (s — 1)?(s — 2). Therefore, 
y(t) € &,, which has standard basis By, = {e’, te’, tel, et. Since te’ and te! 
are the only functions in B,, but not in Bj, it follows that our test function has the 
form yp(t) = a,te’ +-aot*e! for unknown constants a, and a>. We determine a; and 
az by plugging yp(t) into the differential equation. A calculation of derivatives gives 


Vp = ayte’ + arte! 
Yp = are’ + (a, + 2a2)te’ + ate! 
yy = (2a, + 2ay)e’ + (ay + 4ay)te + ante! . 
Substitution into y” — 3y’ + 2y = 2te’ gives 
2te’ = yy —3y, + 2Yp 


= (—a, + 2a2)e' — 2ante’. 


Here is an example where we invoke the linear independence of B,,. By Theorems 7 
and 8 of Sect. 3.2, we have that the coefficients a; and az satisfy 


—d, + 2a, = 0 
—2a> = 2. 
From this, we find ay = —1 and a; = 2a = —2. Hence, a particular solution is 
yp(t) = —2te* — t?e* 


and the general solution is 
y(t) = yp(t) + yn(t) = —2te* — t7e* + cre’ + re”, 


where c; and cp are arbitrary real constants. < 


Linearity is particularly useful when the forcing function f(t) is a sum of terms. 
Here is the general principle, sometimes referred to as the superposition principle. 


Theorem 8 (Superposition Principle). Suppose yp, is a solution to L(y) = fi 
and Y py is a solution to L(y) = fo, where L is a linear differential operator. Then 
A Yp, + 42Yp, isa solution to Ly = a, fi + ap fr. 


Proof. By linearity, 


L(a1 yp, +42Ypp) = aL (yp,)+a2L (yp) = a fi +a2 fr. oO 
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Example 9. Find the general solution to 
y” — 5y’ + 6y = 124 4e”. (5) 


> Solution. Theorem 8 allows us to find a particular solution by adding together 
the particular solutions to 


y" — Sy! + 6y = 12 (6) 

and 
y" —5y' + 6y = 4e”. (7) 
In both cases, the characteristic polynomial is g(s) = s*—5s +6 = (s—2)(s—3).In 
(6), the Laplace transform of 12 is 12/s. Thus, v(s) = s, g(s)v(s) = s(s—2)(s —3), 
and By, = {1, e7! e\. The test function is y,, = a. It is easy to see that y,, = 


2. In Example 5, we found that y,, = —4te*! is a particular solution to (7). By 
Theorem 8, yp = 2 — 4te”! is a particular solution to (5). Thus, 


y =2—4te* + cye™ + ce 


is the general solution. < 
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Exercises 


1-9. Given q(s) and v(s) below, determine the test function yp for the differential 
equation q(D)y = f, where Lf = u/v. 

1. g(s) =s?-s—2 ws) =s-—3 

2. gis) =s?+6s4+8, v(s)=5s+3 

3. g(s) =s?-5s+6, v(s)=s—2 

4. q(s) =s?—7s+12, v(s) = (s — 4) 
5. q(s) = (s—5),_ v(s) = 5? +. 25 

6. gis) =s? +1, v(s)=s?+4 

7. gis) =s? +4, v(s)=s?44 

8. g(s) =s? +4545, v(s) = (s—1)? 
9. g(s) =(s—1)*, ws) =s? +4545 


10-24. Find the general solution for each of the differential equations given below. 


10. y” + 3y’—4y =e” 

11. y” —3y’ —10y = 7e-# 

12. y"+2y'+y=e 

13. y’+2y’+y=e7 

14. y"+3y’+2y =4 

15. y+ 4y’+5y=e* 

16. y’+4y=1+e' 

17. y"-y=P? 

18. y”—4y’+ 4y =e! 

19. y” —4y’ + 4y = e* 

20. y’ + y =2sint 

21. y” + 6y’ + 9y = 25te” 

22. y” + 6y’ + 9y = 25te-*# 

23. y” + 6y’ + 13y =e * cos 2t 

24. y” — 8y’ + 25y = 104sin 3¢ 

25-28. Solve each of the following initial value problems. 
25. y” —5y’—-6y =e", y(0)=2,y/(0)=1 
26. y” + 2y’+5y =8e", y(0) =0, y'(0) = 8 
27. y’+y =10e", y(0)=0, y’(0) =0 

28. y’—4y =2-8t, y(0)=0,y'(0) =5 
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3.5. The Incomplete Partial Fraction Method 


In this section, we provide an alternate method for finding the solution set to the 
nonhomogeneous differential equation 


q(D)(y) = f(t), (1) 


where f € €. This alternate method begins with the Laplace transform method and 
exploits the efficiency of the partial fraction decomposition algorithm developed in 
Sects. 2.3 and 2.4. However, the partial fraction decomposition applied to Y(s) = 
L{y}(s) is not needed to its completion. We therefore refer to this method as the 
incomplete partial fraction method. For purposes of illustration and comparison to 
the method of undetermined coefficients let us reconsider Example 5 of Sect. 3.4. 


Example 1. Find the general solution to 
x = 5y’ 4 6y = de". 


> Solution. Our goal is to find a particular solution y,(¢) to which we will add the 
homogeneous solutions yy(t). Since any particular solution will do, we begin by 
applying the Laplace transform with initial conditions y(0) = 0 and y’(0) = 0. The 
characteristic polynomial is g(s) = s? — 5s + 6 = (s — 2)(s — 3) and L {4e7"\ = 
4/(s —2). If, as usual, we let Y(s) = L{y}(s) and take the Laplace transform of the 
differential equation with the given initial conditions, then g(s)Y(s) = 4/(s — 2) 
so that 
4 4 


~ (Da) (—22(s—3) 


In the table below, we compute the (s — 2)-chain for Y(s) but stop when the 
denominator reduces to q(s) = (s — 2)(s + 3). 


Y(s) 


Incomplete (s — 2)-chain 


4 4 
(s — 2)?(s — 3) (s — 2)? 


D(s) 
(s — 2)(s — 3) 


The table tells us that 


4 as, p(s) 
(26-3) G2? G—2H6—3) 
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There is no need to compute p(s) and finish out the table since the inverse Laplace 

transform of pe = PS is in €, and hence a solution of the associated 
s—2)(s—3) q(s) q 

homogeneous equation. If Y,(s) = Gay then y,(t) = L7'{Y,}(t) = —4te” 


is a particular solution. By linearity, we get the general solution: 
y(t) = —4te” + cye + cye*. < 


Observe that the particular solution yp (t) we have obtained here is exactly what 
we derived using the method of undetermined coefficients in Example 5 of Sect. 3.4 
and is obtained by one iteration of the partial fraction decomposition algorithm. 


The Incomplete Partial Fraction Method 


We now proceed to describe the procedure generally. Consider the differential 
equation 


q(D)(y) = fl), 


where q(s) is a polynomial of degree 2 and f € €. Suppose L{f} = u(s)/v(s). 
Since we are only interested in finding a particular solution, we can choose initial 
conditions that are convenient for us. Thus, we will assume that y(0) = 0 and 
y’(0) = O, and as usual, let Y(s) = £L{y}(s). Then applying the Laplace transform 
to the differential equation q(D)(y) = f(t) and solving for Y(s) give 


u(s) 


aay. 


Let us consider the linear case where v(s) = (s — y)” and u(s) has no factors of 
s —y. (The quadratic case, v(s) = (s?-+cs +d)" is handled similarly.) This means 
F(t) = p(tye”s, where the degree of p is m — 1. It could be the case that y is a root 
of q(s) with multiplicity 7, in which case we can write 


q(s) = (s—y)qy(s), 
where g,(y) 4 0. Thus, 


u(s) 


Y — - : 
= Goya) 


For convenience, let po(s) = u(s). We now iterate the partial fraction decompo- 
sition algorithm until the denominator is q(s). This occurs after m iterations. The 
incomplete (s — y)-chain is given by the table below. 
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Incomplete (s — y)-chain 


Pols) A, 
(s—y)™tiq,(s) (s—y)™ti 
Pils) Ay 


(s— y)ti—'q,(s) Gp 


Pm-1(S) Am 
(s—y)i*!@y(s) (s—y)i*t 
Pm(X) 


(s — y)/qy(s) 


The last entry in the first column has denominator g(s) = (s — y)/q,(s), and 
hence, its inverse Laplace transform is a solution of the associated homogeneous 


equation. It follows that if Y,(s) = oe corer then 
A +j-l,yt Aim cf whe 
Yp(t) = - a Sa a ee ae 

(m+ j—1)! (7)! 


is a particular solution. 
To illustrate this general procedure, let us consider two further examples. 


Example 2. Find the general solution to 


y” + Ay’ + 4y = 2te". 


> Solution. The characteristic polynomial is g(s) = s* + 4s + 4 = (s + 2)? and 
L{2te 7" = 2/(s + 2)*. Again assume y(0) = 0 and y’(0) = 0 then 


But this term is a partial fraction. In other words, the incomplete (s + 2)-chain for 
Y(s) degenerates: 


248 3. Second Order Constant Coefficient Linear Differential Equations 


Incomplete (s + 2)-chain 


2 2 
(s+2)* | (s+2)* 


0 


Let Y,(s) = 2/(s + 2)*. Then a particular solution is 
=a Oe ee ey 
yet) =L{Yp}) = a! eS a 3 


The homogeneous solution can be read off from the roots of g(s) = (s + 2)*. Thus, 
the general solution is 


1 
y= gre +ce" + ote. <4 


Example 3. Find the general solution to 


y” + 4y = 16te” 


> Solution. The characteristic polynomial is g(s) = s* + 4 and 


16 
LS 16te” = —_. 
\ ' (s) (s — 2)? 
Again assume y(0) = 0 and y’(0) = 0. Then 
16 


9) = payee 


The incomplete s — 2-chain for Y(s) is: 


Incomplete s — 2 -chain 


16 2 
(s2 + 4)(s — 2)? (s — 2)? 
—2(s + 2) —1 
(s2 + 4)(s — 2) s—2 


p(s) 
s?>+4 
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Let Y,(s) = =p — <4. Then y,(t) = 2te" — e*’. The homogeneous solutions 


are Yh = C; cos 2t + C2 sin 2t. Thus, the general solution is 


y(t) = yp(t) + ya(t) = 2te* — e* + c1 cos2t + cp sin 2¢. “ 
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3.5 The Incomplete Partial Fraction Method 251 
Exercises 


1-12. Use the incomplete partial fraction method to solve the following differential 
equations. 


1. y” —4y =e! 

2. y” + 2y' — 15y = 16e" 
3. y" +5y'+6y =e 

4. y"+3y’+2y =4 

5. y” + 2y’ — 8y = 6e-* 
6. y” + 3y’—10y = sint 
7. y” + 6y’ + 9y = 25te! 
8. y” —5y’ — 6y = 10te* 
9. y” — 8y’ + 25y = 36te* sin(3t) 
10. y” —4y' + 4y = te 
11. y’ +2y’+ y =cost 
12. y’ + 2y’+2y =e' cost 
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3.6 Spring Systems 


In this section, we illustrate how a second order constant coefficient differential 
equation arises from modeling a spring-body-dashpot system. This model may arise 
in a simplified version of a suspension system on a vehicle or a washing machine. 
Consider the three main objects in the diagram below: the spring, the body, and the 
dashpot (shock absorber). 


We assume the body only moves vertically without any twisting. Our goal is to 
determine the motion of the body in such a system. Various forces come into play. 
These include the force of gravity, the restoring force of the spring, the damping 
force of the dashpot, and perhaps an external force. Let us examine each of these 
forces and how they contribute to the overall motion of the body. 


Force of Gravity 


First, assume that the body has mass m. The force of gravity, Fg, acts on the body 
by the familiar formula 
Fg = mg, (1) 


where g is the acceleration due to gravity. Our measurements will be positive in the 
downward direction so Fg is positive. 


Restoring Force 


When a spring is suspended with no mass attached, the end of the spring will lie at a 
reference point (u = 0). When the spring is stretched or compressed, we will denote 
the displacement by u. The force exerted by the spring that acts in the opposite 
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direction to a force that stretches or compresses a spring is called the restoring force. 
It depends on the displacement and is denoted by Fr(u). Hooke’s law says that the 
restoring force of many springs is proportional to the displacement, as long as the 
displacement is not too large. We will assume this. Thus, if u is the displacement we 
have 

Fa(u) = —ku, (2) 


where k is a positive constant, called the spring constant. When the displacement 
is positive (downward), the restoring force pulls the body upward, hence the 
negative sign. 

To determine the spring constant k, consider the effect of a body of mass m 
attached to the spring and allowed to come to equilibrium (i.e., no movement). It 
will stretch the spring a certain distance, uo, as illustrated below: 


mass m 
(at equilibrium) 


At equilibrium, the restoring force of the spring will cancel the gravitational force 
on the mass m. Thus, we get 


Fr(uo) + Fo = 0. (3) 
Combining equations (1), (2), and (3) gives us mg — kuo = 0, and hence, 


mg 


uo 


k= (4) 


Damping Force 


In any practical situation, there will be some kind of resistance to the motion 
of the body. In our system, this resistance is represented by a dashpot, which in 
many situations is a shock absorber. The force exerted by the dashpot is called the 
damping force, Fp. It depends on a lot of factors, but an important factor is the 
velocity of the body. To see that this is reasonable, imagine the difference in the 
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forces against your body when you dive into a swimming pool off a 3-meter board 
and when you dive from the side of the pool. The greater the velocity when you 
enter the pool the greater the force that decelerates your body. We will assume that 
the damping force is proportional to the velocity. We thus have 


Fp = -—pv = —pw', 
where v = uw’ is velocity and jy is a positive constant known as the damping 
constant. The damping force acts in a direction opposite the velocity, hence the 
negative sign. 
External Forces and Newton’s Law of Motion 
We will let f(t) denote an external force acting on the body. For example, this 
could be the varying vertical forces acting on a suspension system of a vehicle due 
to driving over a bumpy road. If a = wu” is acceleration, then Newton’s second law 
of motion says that the total force of a body, given by mass times acceleration, is the 
sum of the forces acting on that body. We thus have 

Total Force = Fg + Fre + Fp + External Force, 
which implies the equation 
mu” = mg —ku—pu' + f(t). 

Equation (4) implies mg = —kug. Substituting and combining terms give 


mu” + pul + k(u— uo) = f(t). 


If y = u— uo, then y measures the displacement of the body from the equilibrium 
point, uo. In this new variable, we obtain 


my” + py’ +ky = f(t). (5) 


This second order constant coefficient differential equation is a mathematical 
model for the spring-body-dashpot system. The solutions that can be obtained vary 
dramatically depending on the constants m, jz, and k, and, of course, the external 
force, f(t). The initial conditions, 


y@)=yo and y'(0) =v 
represent the initial position, y(0) = yo, and the initial velocity, y’(0) = vo, of the 


given body. Once the constants, external force, and initial conditions are determined, 
the uniqueness and existence theorem, Theorem 10 of Sect. 3.1, guarantees a unique 
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Table 3.1 Units of measure in metric and English systems 
System Time Distance Mass Force 


Metric seconds (s) meters(m) kilograms (kg) newtons (N) 
English seconds (s) __ feet (ft) slugs (sl) pounds (Ibs) 


Table 3.2 Derived quantities 


Quantity Formula 

velocity (v) distance / time 
acceleration (a) velocity /time 
force (F) mass - acceleration 
spring constant (k) force / distance 
damping constant (j) force /velocity 


solution. Of course, we should always keep in mind that (5) is a mathematical model 
of a real phenomenon and its solution is an approximation to what really happens. 
However, as long as our assumptions about the spring and damping constants are in 
effect, which usually require that y(t) and y’(t) be relatively small in magnitude, 
and the mass of the spring is negligible compared to the mass of the body, the 
solution will be a reasonably good approximation. 


Units of Measurement 


Before we consider specific examples, we summarize the two commonly used units 
of measurement: The English and metric systems. Table 3.1 summarizes the units. 

The main units of the metric system are kilograms and meters while in the 
English system they are pounds and feet. The time unit is common to both. Table 3.2 
summarizes quantities derived from these units. 

In the metric system, one Newton of force (N) will accelerate a 1 kilogram mass 
(kg) 1 m/s”. In the English system, a 1 pound force (Ib) will accelerate a 1 slug mass 
(sl) 1 ft/s. To compute the mass of a body in the English system, one must divide 
the weight by the acceleration due to gravity, which is g = 32 ft/s” near the surface 
of the earth. Thus, a body weighing 64 lbs has a mass of 2 slugs. To compute the 
force a body exerts due to gravity in the metric system, one must multiply the mass 
by the acceleration due to gravity, which is g = 9.8 m/s”. Thus, a 5 kg mass exerts 
a gravitational force of 49 N. 

The units for the spring constant k and damping constant jz are given according 
to the following table. 


k a 
Metric N/m N s/m 
English Ibs/ft Ibs s/ft 
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Example 1. 1. A dashpot exerts a damping force of 10 pounds when the velocity 
of the mass is 2 feet per second. Find the damping constant. 

2. A dashpot exerts a damping force of 6 Newtons when the velocity is 40 
centimeters per second. Find the damping constant. 

3. A body weighing 4 pounds stretches a spring 2 inches. Find the spring constant. 

4. Amass of 8 kilograms stretches a spring 20 centimeters. Find the spring constant. 


> Solution. 1. The force is 10 pounds and the velocity is 2 feet per second. The 
damping constant is given by 4 = force/velocity = 10/2 = 5 lbs s/ft. 

2. The force is 6 Newtons and the velocity is .4 meters per second The damping 
constant is given by 4 = force/velocity = 6/.4 = 15 N s/m. 

3. The force is 4 pounds. A length of 2 inches is 1/6 foot. The spring constant is 
k = force/distance = 4/(1/6) = 24 lbs/ft. 

4. The force exerted by a mass of 8 kilograms is 8 - 9.8 = 78.4 Newtons. A 
length of 20 centimeters is .2 meters. The spring constant is given by k = 
force/distance = 78.4/.2 = 392 N/m. 


A 


Example 2. A spring is stretched 20 centimeters by a force of 5 Newtons. A body 
of mass 4 kilogram is attached to such a spring with an accompanying dashpot. 
Att = 0, the mass is pulled down from its equilibrium position a distance of 50 
centimeters and released with a downward velocity of 1 meter per second. Suppose 
the damping force is 5 Newtons when the velocity of the body is .5 meter per second. 
Find a mathematical model that represents the motion of the body. 


> Solution. We will model the motion by (5). Units are converted to the kilogram- 
meter units of the metric system. The mass is m = 4. The spring constant k is given 
by k = 5/(.2) = 25. The damping constant is given by uw = 5/.5 = 10. Since 
no external force is mentioned, we may assume it is zero. The initial conditions are 
y(0) = .5 and y’(0) = 1. The following equation 


4y"(t) + 10y"(t)+25y =0, yO)=.5, y'(O)=1 


represents the model for the motion of the body. < 


Example 3. A body weighing 4 pounds will stretch a spring 3 in. This same body 
is attached to such a spring with an accompanying dashpot. At t = 0, the mass is 
pulled down from its equilibrium position a distance of 1 foot and released. Suppose 
the damping force is 8 pounds when the velocity of the body is 2 feet per second. 
Find a mathematical model that represents the motion of the body. 


> Solution. Units are converted to the pound-foot units in the English system. The 
mass ism = 4/32 = 1/8 slugs. The spring constant k is given by k = 4/(3/12) = 
16. The damping constant is given by ~ = 8/2 = 4. Since no external force is 
mentioned, we may assume it is zero. The initial conditions are y(0) = 1 and 
y’(0) = 0. The following equation 
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1 
gy O+4yO + ley=0, yO=L yO=0 


models the motion of the body. < 


Let us now turn our attention to an analysis of (5). The zero-input response 
models the motion of the body with no external forces. We refer to this motion 
as free motion (f(t) = 0). Otherwise, we refer to the motion as forced motion 
(f(t) 4 0). In turn, each of these are divided into undamped (1 = 0) and damped 


(u # 0). 


Undamped Free Motion 


When the damping constant is zero and there is no externally applied force, the 
resulting motion of the object is called undamped free motion or simple harmonic 
motion. This is an idealized situation, for seldom, if ever, will a system be free of 
any damping effects. Nevertheless, (5) becomes 


my" +ky =0, (6) 


with m > 0 andk > 0. The characteristic polynomial of this equation is q(s) = 
ms? +k = m(s? + k/m) = m(s? + B*), where B = ./k/m. Further, we have 
B, = {sin Bt, cos Bt}. Hence, (6) has the general solution 


y =c, cos Bt +c sin Bt. (7) 


Using the trigonometric identity cos(6Bt — 6) = cos(Bt)cos6 + sin(Br) sind, (7) 
can be rewritten as 
y = Acos(ft — 54), (8) 


where c} = Acos6é and c, = Asin6d. Solving these equations for A and 6 gives 


A = ,/c] +c} and tan = cy/c;. Therefore, the graph of y(t) satisfying (6) is a 
pure cosine function with frequency B and with period 


fea anf 
= — =27,/—. 
B k 


The numbers A and 6 are commonly referred to as the amplitude and phase angle of 
the system. Equation (8) is called the phase-amplitude form of the solution to (6). 
From (8), we see that A is the maximum possible value of the function y(t), and 
hence the maximum displacement from equilibrium, and that |y(¢)| = A precisely 
when t = (6 + nz)/fB, where n € Z. 
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The graph of (8) is given below and well represents the oscillating motion of the 
body. This idealized kind of motion occurs ubiquitously in the sciences. 


y(t) 


Blo K 


Example 4. Find the amplitude, phase angle, and frequency of the damped free 
motion of a spring-body-dashpot system with unit mass and spring constant 3. 
Assume the initial conditions are y(0) = —3 and y’(0) = 3. 


> Solution. The initial value problem that models such a system is 
y"+3y=0, (0) = -3, y’(0) = 3. 
An easy calculation gives y = —3 cos /3t + /3 sin V3t. The amplitude is given 


by A = ((—3)? + (/3)2)2 = 23 and the phase angle is given implicitly by 
tan = —./3/3 hence 6 = —1/6. Thus, 


y = 2300s (V31 + =). < 


Damped Free Motion 


In this case, we include the damping term p y’ with 4 > 0. In applications, the 
coefficient jz represents the presence of friction or resistance, which can never be 
completely eliminated. Thus, we want solutions to the differential equation 


my" + py’ +ky =0. (9) 


The characteristic polynomial g(s) = ms* + us + k has roots r; and rz given by 
the quadratic formula 


—wt Vp? —4mk 
TL,%= ; (10) 
2m 
The nature of the solutions of (9) are determined by whether the discriminant D = 
pw? —4mk is negative (complex roots), zero (double root), or positive (distinct roots). 


We say that the system is 
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¢ Underdamped if D < 0. 
¢ Critically damped if D = 0. 
¢ Overdamped if D > 0. 


Let us consider each of these cases separately. 


Underdamped Systems 


When 1 is between 0 and /4mk then D < 0, the damping is not sufficient to 
overcome the oscillatory behavior that we saw in the undamped case, jz = 0. The 
resulting motion is called underdamped free motion. Observe that in this case we 
can write 


q(s) =m (s + Bs + ) = m((s — a)” + B’), 
m m 


/ —y2 
where w = —# and B = —, Since By = {e* cos Bt,e™ sin Br}, the 


solution to (9) is 
y(t) =e (ce, cos Bt + cz sin Br), 


which can be rewritten as 


y(t) = Ae” cos(Bt — 8), (11) 


where A = al Ge + ce and tané = c2/c,, as we did earlier for the undamped case. 


Again we refer to (11) as the phase-amplitude form of the solution. A typical graph 
of (11) is given below. 


Notice that y appears to be a cosine curve in which the amplitude oscillates between 
Ae™ and —Ae®%’. The motion of the body passes through equilibrium at regular 
intervals. Since a < 0, the amplitude decreases with time. One may imagine the 
suspension on an automobile with rather weak shock absorbers. A push on the 
fender will send the vehicle oscillating as in the graph above. 
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Critically Damped Systems 


If «4 = V4mk, then the discriminant D is zero. At this critical point, the damping 
is just large enough to overcome oscillatory behavior. The resulting motion is called 
critically damped free motion. Observe that the characteristic polynomial can be 
written 

q(s) = m(s—ry, 


where r = —/2m < 0. Since B, = {e"', tet} the general solution of (9) is 

y(t) =cye™ + cote™ = (c) + cot)e”. (12) 
In this case, there is no oscillatory behavior. In fact, the system will pass through 
equilibrium only if ¢ = —c;/c2, and since t > 0, this only occurs if c; and cz have 


opposite signs. The following graph represents the two possibilities. 


system does not pass 
through equililbrium 


system passes through 
equililbrium 


Overdamped Systems 


When yx > V4mk, then the discriminant D is positive. The resulting motion is 
called overdamped free motion. The characteristic polynomial g(s) has two distinct 
real roots: 


_ ht V2 — 4mk sae —p— fp? —4mk 


r 
2m 2m 


Both roots are negative. Since B, = {e"!’, e”}, the general solution of (9) is 
y(t) =cye"™ + ce. (13) 


The graphs shown for the critically damped case are representative of the possible 
graphs for the present case as well. 
Notice that in all three cases 


lim y(t) =0 
too 


and thus, the motion of y(t) dies out as ¢ increases. 
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Undamped Forced Motion 


Undamped forced motion refers to the motion of a body governed by a differential 
equation 
my" +ky = f(t), 


where f(t) is a nonzero forcing function. We will only consider the special case 
where the forcing function is given by f(t) = Focoswt where Fo is a nonzero 
constant. Thus, we are interested in describing the solutions of the differential 
equation 


my" +ky = Focosat, (14) 


where, as usual, m > 0 and k > 0. Imagine an engine embedded within a spring- 
body-dashpot system. The spring system has a characteristic frequency B = /k/m 
while the engine exerts a cyclic force with frequency w. 

To make things a little easier, we will assume the initial conditions are y(0) = 0 
and y’(0) = 0. Applying the Laplace transform to (14) gives 


1 Fos Fo B AY 
Y(s) = = ‘ 15 
(s) ms? +k s?+@2 mB s2 + B2 52+? >) 


Then the convolution theorem, Theorem 1 of Sect. 2.8, shows that 
=] Fo : 
y(t) = £ (Y(s)) = — sin Bt * cosat. (16) 
mp 
The following convolution formula comes from Table 2.11: 


oe (coswt—cos Bt) if B #a@ 
sin Bt * coswt = pe (17) 


—t sinwt if Pp =o. 
5 B 


Combining equations (16) and (17) gives 


mF nay (08H! — £08 81 ifB Ao 
yi) = (18) 
Fo, 
tsinwt ifB =o. 
2mw 


We will first consider the case 8 4 w in (18). Notice that, in this case, the solution 
y(t) is the sum of two cosine functions with equal amplitude (= Fo/m(B* — w7)), 
but different frequencies 6 and w. Recall the trigonometric identity 


cos(@ — ¢) — cos(6 + @) = 2siné sing. 
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If we set 9 —¢@ = wt andd+¢ = ft and solve for 0 = (6 + w)t/2 and 
o = (B —@)t/2, we see that we can rewrite the first part of (18) in the form 


_ ——-2Fo a (B—o)t ia (B+ @)t 
~ a(p? — ”) 2 ae 


y(t) (19) 


One may think of the function y(t) as a sine function, namely, sin((6 + w)t/2) 
(with frequency (B + w)/2), which is multiplied by another function, namely, 


2Fo ae (6 = w)t 
a(p2 — w?) 2° 


which functions as a time varying amplitude function. 

An interesting case is when f is close to w so that B + @ is close to 2w and 
B—a is close to 0. In this situation, one sine function changes very rapidly, while the 
other, which represents the change in amplitude, changes very slowly as is illustrated 
below. (In order for the solution to be periodic, we must also require that B/@ be a 
rational number. Periodicity of the solution is further discussed in Sect. 6.8.) 


One might observe this type of motion in an unbalanced washing machine. The 
spinning action exerts a cyclic force, Fy cos wt, on the spring system which operates 
at a characteristic frequency B which is close to w. The chaotic motion that 
results settles down momentarily only to repeat itself again. In music, this type of 
phenomenon, known as beats, can be heard when one tries to tune a piano. When 
the frequency of vibration of the string is close to that of the tuning fork, one hears 
a pulsating beat which disappears when the two frequencies coincide. The piano is 
slightly out of tune. 

In the case where the input frequency and characteristic frequency are equal, 
B = a, in (18), the solution 


Fi 
y(t) = —° tsinwt 
2aw 


is unbounded as t — ow as illustrated below. 
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The resulting amplification of vibration eventually becomes large enough to destroy 
the mechanical system. This is a manifestation of resonance discussed further in 
Sects. 4.5 and 6.8. 
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Exercises 


Assume forces are in pounds or newtons and lengths are in feet or meters. 


1-4. Assume Hooke’s law. 


I, 
2. 


3. 


4. 


A body weighing 16 lbs stretches a spring 6 in. Find the spring constant. 

The spring constant of a certain spring is k = 20 lbs/ft. If a body stretches the 
spring 9 inches, how much does it weigh? 

A mass of 40 kilograms stretches a spring 80 centimeters. Find the spring 
constant. 

The spring constant of a certain spring is k = 784 N/m. How far will a mass of 
20 kilograms stretch the spring? 


5-8. Assume the damping force of a dashpot is proportional to the velocity of the 
body. 


2: 


6. 


A dashpot exerts a damping force of 4 lbs when the velocity of the mass is 6 
inches per second. Find the damping constant. 

A dashpot exerts a damping force of 40 Newtons when the velocity is 30 
centimeters per second. Find the damping constant. 


. A dashpot has a damping constant jz = 100 Ibs s/ft and decelerates a body by 


4 ft per second. What was the force exerted by the body? 


. A force of 40 N is applied on a body connected to a dashpot having a damping 


constant 44 = 200 N s/m. By how much will the dashpot decelerates the body? 


9-14. For each exercise, investigate the motion of the mass. For undamped or 
underdamped motion, express the solution in the amplitude-phase form: that is, 
y = Ae™ cos(Bt + ). 


9. 


10. 


11. 


A spring is stretched 10 centimeters by a force of 2 Newtons. A body of mass 
6 kilogram is attached to such a spring with no dashpot. At t = 0, the mass 
is pulled down from its equilibrium position a distance of 10 centimeters and 
released. Find a mathematical model that represents the motion of the body and 
solve. Determine the resulting motion. What is the amplitude, frequency, and 
phase shift? 

A body of mass 4 kg will stretch a spring 80 centimeters. This same body is 
attached to such a spring with an accompanying dashpot. Suppose the damping 
force is 98 N when the velocity of the body is 2 m/s. At t = 0, the mass is given 
an initial upward velocity of 50 centimeters per second from its equilibrium 
position. Find a mathematical model that represents the motion of the body and 
solve. Determine the resulting motion. After release, does the mass every cross 
equilibrium? If so, when does it first cross equilibrium? 

A body weighing 16 pounds will stretch a spring 6 inches. This same body is 
attached to such a spring with an accompanying dashpot. Suppose the damping 
force is 4 pounds when the velocity of the body is 2 feet per second. At tf = 0, 
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12. 


13. 


14. 


15. 


16. 
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the mass is pulled down from its equilibrium position a distance of 1 foot and 
released with a downward velocity of 1 foot per second. Find a mathematical 
model that represents the motion of the body and solve. 

A body weighing 32 pounds will stretch a spring 2 feet. This same body is 
attached to such a spring with an accompanying dashpot. Suppose the damping 
constant is 8 lbs s/ft. At t = 0, the mass is pulled up from its equilibrium 
position a distance of 1 foot and released. Find a mathematical model that 
represents the motion of the body and solve. Determine the resulting motion. 
After release, does the mass every cross equilibrium? 

A body weighing 2 pounds will stretch a spring 4 inches. This same body 
is attached to such a spring with no accompanying dashpot. At t = 0, the 
body is pushed downward from equilibrium with a velocity of 8 inches per 
second. Find a mathematical model that represents the motion of the body and 
solve. Determine the resulting motion. After release does the mass every cross 
equilibrium? 

A spring is stretched 1 m by a force of 5 N. A body of mass 2 kg is attached 
to the spring with, accompanying dashpot. Suppose the damping force of the 
dashpot is 6 N when the velocity of the body is | m/s. At t = 0, the mass is 
pulled down from its equilibrium position a distance of 10 centimeters and given 
an initial downward velocity of 10 centimeters per second. Find a mathematical 
model that represents the motion of the body and solve. Determine the resulting 
motion. After release, does the mass every cross equilibrium? 

Suppose m, j, and k are positive. Show that the roots of the polynomial q(s) = 
ms? + ps +k 


1. Are negative if the roots are real. 
2. Have negative real parts if the roots are complex. 


Conclude that a solution to my” + wy’ + ky = 0 satisfies 
a 
Prove that a solution to an overdamped or critically damped system 
my" + py’ +ky =0 


crosses equilibrium at most once regardless of the initial conditions. 
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3.7 RCL Circuits 


In this section, we consider RCL series circuits. These are simple electrical circuits 
with a resistor, capacitor, and inductor connected to a power source in series. The 
diagram below gives the basic components which we discuss below. 


ans 
wre 


Charge 


A charge is a fundamental property of matter that exhibits electrostatic attraction or 
repulsion. An electron is said to have a charge of —1 and a proton has a charge of 
+1. A coulomb, abbreviated C, the basic unit of measuring charge, is equivalent to 
the charge of about 6.242 x 10!® protons. 


Current 


The rate at which charged particles flow through a conductor is called current. Thus, 
if g(t) represents the charge at a cross section in the circuit at time ¢, then current, 
I(t), is given by 

I(t) = q'(t). 


Current is measured in amperes, abbreviated amp, which is coulombs per second, 
coulomb/s. In conventional flow, I(t) is positive when charge flows from the 
positive terminal of the supply V. 


Voltage 


As electrons move through a circuit, they exchange energy with its components. 
The standard unit of energy is the joule, abbreviated J. Voltage is defined to be the 
quotient between energy and charge and is measured in joules per coulomb, J/C. We 
let E(t) be the source voltage, V, in the diagram. 
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The charge, current, and voltage all obey basic fundamental laws with respect to 
the components in a RCL circuit. We discuss these laws for each component below. 


Resistor 


As current flows through a resistor, energy is exchanged (usually in the form of heat) 
resulting in a voltage drop. The voltage drop, Vr, from one side of the resistor to the 
other is governed by Ohim’s law: 


Va(t) = RI(t), (1) 


where R is a positive constant called the resistance of the resistor. The unit of 
resistance, called the ohm and abbreviated Q, is measured in voltage per ampere, 
V/A. For example, a resistor of 1 Q will cause a voltage drop of | V if the current 
is 1A. 


Capacitor 


A capacitor consists of two parallel conducting plates separated by a thin insulator. 
Current flows into a plate increasing the positive charge on one side and the negative 
charge on the other. The result is an electric field in the insulator between the plates 
that stores energy. That energy comes from a voltage drop across the capacitor and 
is governed by the capacitor law: 


Volt) = 2400) 


where q(t) is the charge on the capacitor and C is a positive constant called the 
capacitance of the capacitor. The unit of capacitance, called a farad and abbreviated 
F, is measured in charge per voltage, C/V. For example, a |-farad capacitor will hold 
a charge of | C at a voltage drop of 1 volt. Since a coulomb is so large, capacitance is 
sometimes measured in millifarad (1 mF = 107? F) or microfarad (1 pF= 10~°F). 


Inductor 


An inductor is typically built by wrapping a conductor such as copper wire in the 
shape of a coil around a core of ferromagnetic material.’ As a current flows, a 


Sometimes other materials are present. 
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Table 3.3. Standard units of measurement for RCL circuits 


Unit of unit relation to 
Quantity Symbol measurement symbol _ other units 
Energy Joule J 
Time t Second s 
Charge qd Coulomb Cc 
Voltage EorV Volt Vv J/C 
Current I Ampere A C/s 
Resistance R Ohm Q V/A 
Capacitance C Farad F C/V 
Inductance L Henry H V/(A/s) 


magnetic field about the inductor forms which stores energy and resists any change 
in current. The resulting voltage drop is governed by Faraday’s law: 


WH Lr, (2) 
where L is a positive constant called the inductance of the inductor. The unit of 
inductance, called the henry and abbreviated H, is measured in voltage per change 
in ampere, V/(A/s). For example, an inductor with an inductance of 1 H produces a 


voltage drop of | V when the current through the inductor changes at a rate of 1 A/s. 
Table 3.3 summarizes the standard units of measurement for RCL circuits. 


Kirchoff’s Laws 


There are two laws that govern the behavior of the current and voltage drops in a 
closed circuit due to Gustaf Kirchoff. 


Kirchoff’s Current Law 


The sum of the currents flowing into and out of a point on a closed circuit is zero. 


Kirchoff’s Voltage Law 


The sum of the voltage drops around a closed circuit is zero. 

The voltage drop across the voltage source is — F(t) in conventional flow. Thus, 
Kirchoff’s voltage law implies Vp + Ve + Vi — E = 0. Now using Ohm’s law, the 
capacitor law, and Faraday’s law, we get 


RI(t) + oO) + LI'(t) = E(t). (3) 
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Table 3.4 Spring-body-mass and RCL circuit correspondence 


Spring system RCL circuit 

my” + uy’ tky =f Lq" +Rq' + U/C)q = EW) 
Displacement y Charge qd 
Velocity y’ Current q =! 
Mass m Inductance L 
Damping constant i Resistance R 
Spring constant k (Capacitance)! 1/C 
Forcing function F(t) Applied voltage E(t) 


Now using the fact that q(t) = I(t), we can rewrite (3) to get 


1 
Lq"(t) + Rq'(t) + cI = EO. (4) 


In many applications, we are interested in the current /(t). If we differentiate (4) 
and use I(t) = q'(t), we get 


LI"(t) + RI + al = E'(t). (5) 


Frequently, we are given the initial charge on the capacitor g(0) and the initial 
current J(0). By evaluating (3) at t = 0, we obtain /’(0). 

The equations that model RCL circuits, (4) and (5), and the equation that models 
the spring-body-dashpot system, (5) of Sect. 3.6, are essentially the same. Both are 
second order constant coefficient linear differential equations. Table 3.4 gives the 
correspondence between the coefficients. The formulas in the coefficients m, jz, and 
k that describe concepts such as harmonic motion; underdamped, critically damped, 
and overdamped motion; resonance; etc. for spring systems, have a correspondence 
in the coefficients R, C, and L for RCL simple circuits. For example, simple 
harmonic motion with frequency 8 = ,/k/m ina spring system occurs when there 
is no dashpot. Likewise, simple harmonic motion with frequency B = 1//LC in 
an RCL circuit occurs when there is no resistor. 


Example 1. A circuit consists of a capacitor and inductor joined in series as 
illustrated. 


1F 
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There is no voltage supply. Suppose the capacitor has a capacitance of 1 F and 
initial charge of q(0) = 0.2 C. Suppose the inductor has inductance 0.25 H. If there 
is no initial current find the current, /(t¢), at time ¢. What is the system frequency, 
amplitude, and phase angle? What is the charge on the capacitor at time t = 7/4. 


> Solution. We use (5) to model the current and get 
0.251” + 1 =0. (6) 


We have /(0) = 0. To determined /’(0), we evaluate (3) at t = 0 and use (0) = 0, 
q(O) = 0.2, and E(0) = 0 to get 0.2 + 0.25/7'(0) = 0, and hence, J’(0) = 
—0.2/0.25 = —0.8. We now multiply (6) by 4 to get the following initial value 
problem: 


I” +41 =0, 1(0)=0, I’'(0) =-08. 


A simple calculation gives 
: ca 
I(t) = —0.4sin2t = 0.4cos (20 + 5) ‘ 


From the phase-amplitude form, it follows that the system frequency is 2, the 
amplitude is 0.4, and the phase angle is —/2 (see the explanation after 3.6.(8) 
where these terms are defined). Since 


q(t) — 0.2 = q(t) — q(0) 


= a I(t) dt 


t 
—cos2t 


= (—0.4) = 0.2(cos 2t — 1) 


0 


it follows that q(t) = 0.2 cos 2t. Hence, the charge on the capacitor at t = 1/4 is 
q(1/4) = 0 coulombs. < 


Example 2. A resistor, capacitor, and inductor, are connected in series with a 
voltage supply of 14 V as illustrated below. 


99 
— 7 
—__7F 

1H 


a C) 


— UAW 
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Find the charge on the capacitor at time ¢ if the initial charge and initial current 
are 0. In the long term, what will be the charge on the capacitor and the current in 
the circuit. 


> Solution. We have g(0) = 0 and q’(0) = J(0) = 0. Equation (4) gives 
q’ +9q'+14qg=14, g(0) =0, g'(0) = 0. 


The Laplace transform method gives 


14 1 2 1 7 1 
O(s) = =-+ - 
s(s+2)(s+7) s 58+7 58542 
Hence, 
2 7 
th=1+ ie %-—-—e™, 
q(t) 5 5 
Observe that lim g(t) = 1. This means that in the long term the charge on the 
too 


capacitor will be 1C. Since [(t) = q’(t) = a (ec? —e~") and lim J(t) = 0, 
too 


there will be no current flowing in the long term. < 
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Exercises 


1-4. Find the current and charge for each RCL series circuit from the data given 
below. Where appropriate, express the current in phase-amplitude form: that is, 
I(t) = Ae~™ cos(Bt — 6). 


R=102,C =5mE,L =0.25H, V =6V,q(0) = 0C, 1(0) =0A. 
R=52,C = .025F, L =0.1H, V =0V,q(0) = 0.01C, (0) = 0A. 
_R=42,C = .05F, L =0.2H, V = 25sin5t V,q(0) = 0C, 1(0) =2A. 
_R=1192,C =1/30E, L =1H,V = 10e™ V,g(0) = 1C, 1(0) = 2A. 


AND 


5. An RCL circuit consists of a 0.1-H inductor and a 0.1-F capacitor. The capacitor 
will fail if it reaches a charge greater than 2 C. Assume there is no initial 
charge on the capacitor and no initial current. A voltage supply is connected 
to the circuit with alternating current given by V = (1/10) cos5t. Determine 
the charge and whether the capacitor will fail. 

6. An RCL circuit consists of a 0.1-H inductor and a 0.1-F capacitor. The capacitor 
will fail if it reaches a charge greater than 2 C. Assume there is no initial 
charge on the capacitor and no initial current. A voltage supply is connected 
to the circuit with alternating current given by V = (1/10) cos 10t. Determine 
the charge and whether the capacitor will fail. 


Chapter 4 
Linear Constant Coefficient Differential 
Equations 


Two springs systems (without dashpots) are coupled as illustrated in the diagram 
below: 


Let y; and yz denote the displacements of the bodies of mass m, and m2 from 
their equilibrium positions, yj = 0 and yy = O, respectively, where distances are 
measured in the downward direction. In these coordinates, y(t) and y2(t) — y,(t) 
represent the length the upper and lower springs are stretched at time ¢. There are 
two spring forces acting on the upper body. By Hooke’s law, the force of the upper 
spring is —k, y,(t) while the force of the lower spring is given by k2(y2(t) — yi(t)), 
where k, and kz are the respective spring constants. Newton’s law of motion then 
implies 

my (t) = —kiyi(t) + ko(y2) — yi). 
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The lower spring alone exerts a force of —k2(y2(t) — y,(t)) on the lower body. 
Again Newton’s law of motion implies 


myy3(t) = —ko(y2(t) — yi(t)). 


We are thus led to the following differential equations: 


myyy (t) + (ki + ko) y(t) = koya(t) 
my3(t) + koyo(t) = koyi(t). (1) 


Equation (1) is an example of a coupled system' of differential equations. Notice 
the dependency of each equation on the other: the solution of one equation becomes 
(up to a multiplicative constant) the forcing function of the other equation. In 
Sect.4.4, we will show that both y; and y2 satisfy the fourth order differential 
equation 


yO 4 (at+b4+c)y"+cay =0, (2) 


where a = k,/m,, b = kp/mpz, and c = k/my. It will be the work of this chapter 
to show solution methods for constant coefficient mth order linear differential 
equations such as given in (2), form = 4. We will return to the coupled spring 
problem presented above in Sect. 4.4. 

Much of the theoretical work that we do here is a simple extension of the 
work done in Chap. 3 where we focussed on the second order constant coefficient 
differential equations. Thus, our presentation will be brief. 


‘In Chap. 9, we will study first order coupled systems in greater detail. 
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4.1 Notation, Definitions, and Basic Results 


Suppose do,...,@, are scalars, a, ~ 0, and f is a function defined on some 
interval J. A differential equation of the form 


any” ith ayy feet ayy’ +ajyy = f@), (1) 


is called a constant coefficient nth order linear differential equation. The constants 
do,---,@n, are called the coefficients, and a, is called the leading coefficient. By 
dividing by ay, if necessary, we can assume that the leading coefficient is 1. When 
f = 0, we call (1) homogeneous, otherwise, it is called nonhomogeneous. 

The left-hand side of (1) is made up of a linear combination of differentiations 
and multiplications by constants. If D denotes the derivative operator as in Sect. 3.3, 
then D‘(y) = y. Let 


L=a,D"+---+a,D+a, (2) 


where dg,...d, are the same constants given in (1). Then L(y) = a, y™ +--++ 
aiy’ + aoy and (1) can be rewritten 


Ly=f. 


We call Z in (2) a linear constant coefficient differential operator of order n 
(assuming, of course, that a, 4 0). Since L is a linear combination of powers of D, 
we will sometimes refer to it as a polynomial differential operator. Specifically, if 


—1 
q(s) = A)8" + ay—18" ++++ + ais +a, 


then q is a polynomial of order . Since L is obtained from q by substituting D for 
s, and we will write L = q(D). The polynomial g is referred as the characteristic 
polynomial of L. The operator Z takes a function y that has at least n continuous 
derivatives and produces a continuous function. 


Example 1. Suppose L = D? + D. Find 


L(sint), L(cost), L(), and L(e’) 


> Solution. * L(sint) = D?(sint) + D(sint) 
—cost + cost 
= 0. 
* L(cost) = D?(cost) + D(cost) 
= sint — sint 
0. 


II 
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* Ll) = D*(1)+ Dv) 
= 0. 
* L(e') = Die’) + Dee’) 
=() +) 
= 2e'. < 


We say a function y is a homogeneous solution of L if Ly = 0. Example | shows 
that sin¢, cost, and | are homogeneous solutions of L = D?+D. 


Linearity and Consequences 


It is easy to show by induction that D*(y + y2) = D‘y, + D* y, and D* cy = 
cD* y. The proofs of Propositions 2 and 4 of Sect. 3.3 and Theorem 6 of Sect. 3.3 
extend to give what we put below in one theorem. 


Theorem 2. /. The operator 
L=a,D"+...+a,;D +a 


given by (2) is linear. Specifically, 


a. If y; and y2 have n derivatives, then 
L(y + y2) = L(y) + LQ). 
b. If y has n derivatives and c is a scalar, then 
L(cy) = cL(y). 
2. If y, and yz are homogeneous solutions of L and c, and cz are scalars, then 
Ciy1 + C2y2 
is a homogeneous solution. 


3. Suppose f is a function. If yp is a fixed particular solution to Ly = f and yp is 
any solution to the associated homogeneous differential equation Ly = 0, then 


Yp + Yh 
is a solution to Ly = f. Furthermore, any solution y to Ly = f has the form 


Y= Yp + Yn- 
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Given a constant coefficient linear differential equation Ly = ff, we call 
Ly =0 the associated homogeneous differential equation. The following algo- 
rithm follows from Theorem 2 and outlines an effective strategy for finding the 
solution set to Ly = f. 


Algorithm 3. The general solution to a linear differential equation 


Ly=f 


can be found as follows: 


Solution Method for nth Order Linear Equations 


1. Find all the solutions to the associated homogeneous differential equation 
Ly=0 

2. Find one particular solution y, 

3. Add the particular solution to the homogeneous solutions: 


Yp + Yn. 


AS yy Varies over all homogeneous solutions, we obtain all solutions to 
Ly = f. 


You should notice that this is the same strategy as in the second order case 
discussed in Algorithm 7 of Sect. 3.3. This is the strategy we will follow. Section 4.2 
will be devoted to determining solutions to the associated homogeneous differential 
equation. Section 4.3 will show how to find a particular solution. 


Example 4. Use Algorithm 3 and Example | to find solutions to 


my 


y" + y! = 2e'. 


> Solution. The left-hand side can be written Ly, where L is the differential 
operator 
L=D?+D. 


From Example 1, we found 
« L(e’) = 2e’, 

¢« L(sint) = 0, 

« Li(cost) = 0, 

« LO)=0. 
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Notice that the first equation tells us that a particular solution is y, = e’. The second, 
third, and fourth equations give sint, cost, and | as solutions to the associated 
homogeneous differential equation Ly = 0. Thus, for each scalar c), cz, and c3, 
the function y, = c; sint + cp cost + c3 is a homogeneous solution. Now applying 
Algorithm 3, we have 


Y=Yptyn =e’ +cisint +c. cost + c3 


is a solution to Ly = 2e’, for all scalars c,, co, and c3. At this point, we cannot say 
that this is the solution set, but, in fact, it is. < 


Initial Value Problems 


Suppose L is a constant coefficient linear differential operator of order and f is a 
function defined on an interval /. Let f9 € 7. To the equation 


Ly=f 
we can associate initial conditions of the form 


y(to) = yi, y'(to) = y1,---, 9 Yo) = Yn-a- 


We refer to the initial conditions and the differential equation Ly = f as an initial 
value problem, just as in the second order case. 


Theorem 5 (The Existence and Uniqueness Theorem). Suppose p is an nth 
order real polynomial, L = p(D), and f is a continuous real-valued function 
onan interval I. Let to) € I. Then there is a unique real-valued function y defined 
on I satisfying 


Ly=f y(t) = yo, y'(to) = 1, «0, YY Go) = n-1, (3) 
where yo, Yi, --- ,Yn—-1 € R, Hf I D [0, 00) and f has a Laplace transform then 
so does the solution y. Furthermore, if f is in E, then y is in €. 


When 1 = 2, we get the statement of the existence and uniqueness theorem, 
Theorem 10 of Sect.3.1. Theorem 5 will be proved in a more general context in 
Sect. 9.5. 


Example 6. Use Example 4 to find the solution to the following initial value 
problem: 


Ly =2e, —y(0) =2, y'@ =2, y"@) =3, 


where L = D* + D. 
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> Solution. In Example 4, we verified that 
y=e4+c;sint+c)cost+c¢3 


is a solution to Ly = 2e’ for all scalars c1, c2, and c3. The initial conditions imply 
the following system: 


1 +co.+c¢3 = y(0) =2 
l+c = y/(0) =2 
1 = 69 = y”(0) =3 
Solving this system gives c) = 1, co = —2, and c3 = 3. It follows that 


y =e’ + sint —2cost + 3 


and the existence and uniqueness theorem implies that y is the unique solution. < 
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Exercises 


1-4. Determine which of the following are constant coefficient linear differential 
equations. In these cases, write the equation in the form Ly = f and, determine 
the order, the characteristic polynomial, and whether they are homogeneous. 


1. yl" _ 3y’ =_ el 
2. yYO+y'+4y=0 
3. yO + yt =0 
4, y + ty” —3y =0 


5-8. For the linear operator L, determine L(y). 


5. L= D*—4D 


@) yao" 
(b) y =e 
(c) y=2 

6 L=D-2 
@) y=e™ 
(b) y = 3e 
(c) y = tant 


7. L=D*+5D?+4 


(a) y=e™ 
(b) y =cost 
(c) y = sin2t 
8. L=D?-D?+D-1 
(a) y=e 
(b) y = te! 
(c) y =cost 
(d) y =sint 


9. Suppose L is a polynomial differential operator and 


° L(te”) = 8e% 
> L(e) =0 

+ LEy=0 
« LO 6 


Use this information to find other solutions to Ly = 8e7*. 
10. Suppose L is a polynomial differential operator and 


¢ L(sint) = —15sint 
° L(e”)=0 
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11. 


12, 
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° L(e7) =0 
« L(sin2t) = 0 
« L(cos2t) =0 


Use this information to find other solutions to Ly = —15sint. 
Let L be as in Exercise 9. Use the results there to solve the initial value problem 


Ly = 8e", 


where y(0) = 2, y’/(0) = —1, and y”(0) = 16. 
Let L be as in Exercise 10. Use the results there to solve the initial value 
problem 

Ly =—15sint, 


where y(0) = 0, y’(0) = 3, y”(0) = —16, and y’”(0) = —9. 
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4.2 Linear Homogeneous Differential Equations 


Suppose L = q(D) where g(s) = ays” + +--+ a15 + do. As we will see in this 
section, the characteristic polynomial, g, plays a decisive role in determining the 
solution set to Ly = 0. 


Lemma 1. Let g(s) = ays" +-+++a,5+ ap. If y is a function whose nth derivative 


is of exponential type, then 


Liq(D)y} = q(s)£ {ty} — pls), 


where p(s) is a polynomial of degree at most n — \ and depends on the coefficients 
of q and the initial conditions y(0), y'(0),..., y"~ (0). 


Proof. If y is of exponential type, then so are all derivatives y, k = 0,1,... 
n—1 by Lemma 4 of Sect. 2.2. By the nth transform derivative principle, Corol- 
lary 8 of Sect. 2.2, we have 


L{y} (s) = s*L fy} (5) — pe (s), 


where p;(s) is a polynomial of order at most k — 1 depending on the initial 
conditions y(0), y’(0),..., v4). Let £ {y(t)} = Y(s). Then 
L{q(D)y} (8) = anl {fy} +--+ ail {y} + aol fy} 
= ays" Y(s) +--+ + a)sY(s) + ao¥(s) — p(s) 
= q(s)¥(s) — p(s), 


where p(s) = Gn Pn +--+: + dopo is a polynomial of degree at most n — 1 and 
depends on the initial values y(0), y/(0),..., y"~ (0). Qo 


We now turn our attention to the solution set to 
Ly =0. (1) 
By Theorem 5 of Sect. 4.1, any solution to L{y} = 0 is in €. Suppose y is such a 


solution. By Lemma 1, we have L{Ly} = q(s)L{y}— p(s) = 0. Solving for L{y} 
gives 


s 
L{y}(s) = P(s) € Ry. 
q(s) 
It follows that y € €,. Now suppose y € €,. Then L{y}(s) = ae € Rg and 
(s) 
L{LY}(3) = 46) — = pils) = pls) = Pils), 


q(s) 
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where p(s) is a polynomial that depends on the initial conditions. Note, however, 
that p(s) — p,(s) is a polynomial in 7 and therefore must be identically 0. Thus, 
L{Ly} = 0 and this implies Ly = 0. The discussion given above implies the 
following theorem. 


Theorem 2. Let q(s) be the characteristic polynomial of a linear differential 
operator q(D) of order n. Then the solution set to 


q(D)y =0 


is Ey. Thus, if By = {y1, y2,---,Yn} is the standard basis of E,, then a solution to 
q(D)y = 0 is of the form 


Y= Cy, + C22 +++ + Cnn, 


where C}, C2, ..., Cy are scalars. 
The following algorithm codifies the procedure needed to find the solution set. 


Algorithm 3. Given an nth order constant coefficient linear differential equation 


q(D)y = 90 


the solution set is determined as follows: 


Solution Method for nth order Homogeneous Linear Differential 
Equations 


1. Determine the characteristic polynomial, q(s). 

2. Factor g(s) and construct B, = {1, y2.---,Yn}- 

3. The solution set €, is the set of all linear combinations of the functions in 
the standard basis B,. In other words, 


Eq = Span By = {c1yi(t) +++ + Cn yn(t) 2 c1,---,en € R}. 


Example 4. Find the general solution to the following differential equations: 


1. y" + y! = 0 
2. y¥%-y=0 
3. y) —8y9 + 16y’ = 0 


> Solution. 1. The characteristic polynomial for y” + y’ = 0 is 


g(s) =s? +s =s(s? +1). 
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The standard basis is B, = {1, cost, sint}. Thus the solution set is 
Eq = {c1 +c cost + ¢3 sint : cy, C2,¢3 € R}. 
2. The characteristic polynomial for y“ — y = 0 is 
q(s) =s*-1= (8? + 1)(s—1)(5 + 1). 
The standard basis is B, = {cost, sint, e’,e ‘}. Thus, the solution set is 
= {cer cost +c) sint + c3e’ + cye 2 C1, C2, C3, C4 € R} : 

3. The characteristic polynomial for y© — 8y® + 16y’ = Ois 

q(s) = s° — 857 + 16s = s(s* + 857 + 16) = s(s? — 4)” = s(s —2)°(s + 2). 

The standard basis is B, = {1,e”’, te’,e~”', te~*‘}. Thus, the solution set is 


= {c + ce + este 4+ eye 4 este @ 2 c1,...505 € R} : < 


Initial Value Problems 


Let q(D)y = 0 be a homogeneous constant coefficient differential equation, where 
deg p = n. Suppose y(to) = yo,..., ¥" (to) = yyy are initial conditions. The 
existence and uniqueness Theorem 5 of Sect. 4.1 states there is a unique solution to 
the initial value problem. However, the general solution is a linear combination of 
the n functions in the standard basis €,. It follows then that the initial conditions 
uniquely determine the coefficients. 


Example 5. Find the solution to 
yl" — Ay" + Sy’—2y =0;  y(0) = 1, y’(0) = 2, y"(0) = 0. 
> Solution. The characteristic polynomial is g(s) = s*—4s?+5s—2 and factors as 


q(s) = (s— 1)°(s — 2). 


The basis for , is fe te’, e7! and the general solution is 


y =cye' + egte’ + c3e7. 
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We first calculate the derivatives and simplify to get 


y(t) = eye! + ente’ + c3e7 
y(t) = (cr + er)e! + cote! + 2c3e7" 
y(t) = (cr + 2er)e! + ente’ + 4c3e7". 
To determine the coefficients c,, co, and c3, we use the initial conditions. Evaluating 
at t = 0 gives 
1= y0)=c, +¢3 
2= y'0) =c1 +e. + 203 
0= y"(0) =c, + 2e2 + 4c3. 


Solving these equations gives c; = 4, cz = 4, and c3 = —3. The unique solution is 
thus 

y(t) = 4e' + 4te’ — 3e”. < 
Abel’s Formula 


Theorem 6 (Abel’s Formula). Let g(s) = s” + d,—1s" ' +++: + ays + do and 
suppose fi, fa,..., fn are solutions to q(D)y = 0. Then the Wronskian satisfies 


wf, fo... fr) = KO "," (2) 


for some constant K and { fi, fo,..., fn} is linearly independent if and only if 
w(fi, f2,.--, fn) is nonzero. 


Proof. The essential idea of the proof is the same as the proof of Abel’s Formula 
for n = 2 (see Theorem 8 of Sect. 3.3). First observe that since f; is a solution 
to q(D)y = 0, we have fi! = —ay fo’? — ayo fl”? —---- afl —aofi 
and similarly for fo,..., f,. To simplify the notation, let w = w(fi, fo,..., fn) 
and let F = fi, fo,..., fn be the first row of the Wronskian matrix W(fi,..., fn). 
Then F“) = ia gun Ace fi? is the k + lst row of the Wronskian matrix, for all 
k =1,2,...,n—1, and 


F® = —a,_,F°~) —a,-.F"~? —----—a,F' —aoF. (3) 
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We can thus write 
F 
F / 
F’ 
w = det 


Fo 
Fe-) 


The derivative of w is the sum of the determinants of the matrices obtained by 
differentiating each row one at a time. Thus, 


F' F F F 
F’ F’ F' F’ 
F’ F’ F’ F’ 
w’ = det _| + det _| +-++++ det _| +det 
F (n—2) F (n—2) F a1) F (n—2) 
Fe) Fe-) Fe-v) Fo 


All determinants but the last are zero because the matrices have two equal rows. 
Using (3) and linearity of the determinant gives 


F F F 

F' F’ F’ 

w = —dy_\ det : | — ap—2 det | —+++— ao det 
F (n—2) F (n—2) F°-2 

Fe-) Foe-2 F 


= —an—1W. 


The first determinant is w and the remaining determinants are zero, again because 
the matrices have two equal rows. Therefore, w satisfies the differential equation 
w’ + dy—\w = 0. By Theorem 2 of Sect. 1.5, there is a constant K so that 


w(t) = Ke @r-"", 


If w # 0, then it follows from Theorem 13 of Sect. 3.2 that { fi, fo,..., frp isa 
linearly independent set. 


If w = 0, then the Wronskian matrix at ¢ = 0 is singular and there are scalars 
Cj,---,Cn, not all zero, so that 
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F(0) 


’ F'(0) ‘ 0 
wo) |=] F’O]| *}= 
Cn FD) Cn 0 


Let z(t) = c) fi(t) + ...¢n f(t). Then z is a linear combination of f|,..., f, and 
hence is a solution to g(D)y = 0. Further, from the matrix product given above, 
2(0) = 0,2/(0) = 0,...,2~ (0) = 0. By the uniqueness and existence theorem, 
Theorem 5 of Sect. 4.1, it follows that z(t) = 0 for all t € R. This implies that 
{fi. fo,..-, fn} is linearly dependent. Oo 
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Exercises 


1-9. Determine the solution set to the following homogeneous differential 
equations. Write your answer as a linear combination of functions from the standard 
basis. 


1. y?-y=0 
2. y” —6y” + 12y’-—8y = 0 
3. YY9-y=0 


4, y”+4+2y"4+ y'=0 

5. y) — Sy" 4+4y =0 

6. (D — 2)(D? — 25)y =0 

7. (D + 2)(D? + 25)y =0 

8. (D? +9) y =0 

9. (D +3)(D —1)(D + 3)?y =0 

10-11. Solve the following initial value problems. 


10. yt ei y" = 4 -y= 0, 
y(0) = 1, 0) = 4, y"(0) = -1 
11. yO-y=0, 
y(0) = —1, y’(0) = 6, y"(0) = —3, y’"(0) = 2 
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4.3 Nonhomogeneous Differential Equations 


In this section, we are concerned with determining a particular solution to 


q(D)y=f 


where q(s) is a polynomial of degree n and f € €. In Chap.3, we discussed two 
methods for the second order case: The method of undetermined coefficients and 
the incomplete partial fraction method. Both of these methods are not dependent on 
the degree of g so extend quite naturally. 


The Method of Undetermined Coefficients 


Theorem 1. Suppose L = q(D) is a polynomial differential operator and f € E. 
Suppose Lf = *. Let By denote the standard basis for Eq. Then there is a particular 
solution yy to 

Ly=f 


which is a linear combination of terms in Bg, but not in By. 


Proof. By Theorem 5 of Sect. 4.1, any solution to Ly = f is in € and hence has a 
Laplace Transform. Thus, 


£{q(D)}y) = £(fy= © 
v(s) 
g(s)£ {y} — p(s) = us) by Lemma | of Sect. 4.2 
v(s) 


p(s), _u(s)___u(s) + p(s)r(s) 
TOME (COLO MEE TOLO) 


It follows that y is in €,, and hence a linear combination of terms in B,,. Since 
By C Bgy, we can write y = yp + yp, where yp is the linear combination of terms 
in B, and yp, is a linear combination of terms in B,, but not in B,. Since yp is a 
homogeneous solution, it follows that yy) = y — yp is a particular solution of the 
required form. oO 


Ltys== 


If {f1,-.-,¢m} are the functions in B,, but not in B,, then a linear combination 


aig Se Aandm 


will be referred to as a test function. 
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Example 2. Find the general solution to 
y —y =4cost. 


> Solution. The characteristic polynomial is g(s) = s* — 1 = (s? + 1)(s?-1) = 
(s? + 1)(s — 1)(s + 1). It follows that B, = {cost, sint,e’,e~*}, and hence, the 
homogeneous solutions take the form 


Yh = Cc) cost + co sint + c3e° + cqe". 


For the particular solution, note that £ {cost} = >y>. Let v(s) = s’ + 1 be the 


denominator. Then q(s)v(s) = (s? + 1)?(s — 1)(s + 1) and 
Lie = {cost, tcost,sint,t sint,e’, ed : 


The only functions in 6,, that are not in B, are t cost and t sint. It follows that a test 
function takes the form yp = ajf cost + dot sint. The coefficients are determined 
by substituting y, into the given differential equation. To that end, observe that 

Yp = ait cost + apt sint 

ys = a\(cost —f sint) + ao(sint +f cost) 

yp = ai(—2sint —t cost) + ap(2 cost — tf sint) 


yy, = ai(—3 cost + ft sint) + ao(—3 sint — 1 cost) 


i = a,(4sint + f cost) + a2(—4 cost + ft sin?) 


and thus, 
ye — Yp = 4a sint + —4az cost = 4cost. 


The linear independence of {cos t, sint} and Theorem 7 of Sect. 3.2 imply 


4a, =0 
—4ay = 4. 
Hence, a; = 0 and az = —1 from which we get 


Yp = —t sint. 
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The general solution is thus 


y= yptyn =—tsint +c) cost + cy sint + c3e' + cye . < 
We can summarize Theorem | and the previous example in the following 
algorithm. 
Algorithm 3. If 
qD)y=f 
where q is a polynomial of degree n and f € €, then the general solution can be 
obtained as follows: 


The Method of Undetermined Coefficients 


. Compute the standard basis, B,, for E,. 

. Determine v so that £{f} = %. Thatis, f € &. 

. Compute the standard basis, B,,, for Ey,. 

. The test function, y, is the linear combination with arbitrary coefficients 
of functions in B,, that are not in By. 

5. The coefficients in yp, are determined by plugging yp into the differential 

equation q(D)y = f. 
6. The general solution is given by 


BRWNR 


Vp + Yh; 


where yp € E&4. 


The Incomplete Partial Fraction Method 


The description of the incomplete partial fraction method given in Sect.3.5 was 
independent of the degree of g and so applies equally well here. To summarize the 
method, we record the following algorithm. 


Algorithm 4. If 

qD)y=f, 
where q is a polynomial of degree n and f € €, then the general solution can be 
obtained as follows: 
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The Incomplete Partial Fraction Method 


. Compute L{f} = 4. 
. With trivial initial conditions assumed, write £ {y} = a 


Ne 


3. Apply the partial fraction algorithm on a until the denominator of the 


remainder term is q. 

4. A particular solution yp, is obtained by adding up the inverse Laplace 
transform of the resulting partial fractions. 

5. The general solution is given by 


Yp <5 Yh, 


where yn € & . 


To illustrate this general procedure, let us consider two examples. 


Example 5. Find the general solution to 
ltl = 2y" ae y’ = te’. 


> Solution. The characteristic polynomial is g(s) = s* — 2s? +s = s(s — 1)? 


and L{te’} = ere Assuming trivial initial conditions, y(0) = 0, y’(0) = 0, and 


y"(0) = 0, we get 


1 
Y(s) =Li{y} = Gos" 


The incomplete (s — 1)-chain for Y(s) is 


Incomplete (s — 1)-chain 


1 1 

(s — 1)*s (s — 1)4 
—l —1 

(s — 1)3s (s — 1)3 


p(s) 
(s — 1)?s 
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There is no need to compute p(s) since the denominator is g(s) = (s — 1)?s and 
the resulting inverse Laplace transform is a homogeneous solution. Let Y,(s) = 


=n - Gop Then a particular solution is 


_ 1 1 
Yp = Wnt => Ti = xe: 


Since B, = {1,e",e~"}, we get the general solution 


1 1 
y= ge _ ate tep+oe + cote’. < 


Example 6. Find the general solution to 
yO — y = 4cost. 


> Solution. The characteristic polynomial is g(s) = s*—1 = (s?—1)(s? +1) and 


L£{4cost} = 5 . Again assume y(0) = 0 and y’(0) = 0. Then 


4s 


"OO BGT IE 


Using the irreducible quadratic partial fraction method, we obtain the incomplete 
(s? + 1)-chain for Y(s): 


Incomplete (s* + 1)-chain 


4s —25 
(s2 — 1)(s2 + 1)? (s? + 1)? 


p(s) 
(s2 — 1)(s? + 1) 


By Table 2.9, we have 


a oa) ela cy 
= G41) = sin ft. 


The homogeneous solution as yy = cje’ + ce! + ¢3 cost + c4 Sint, and thus, the 
general solution is 


Y=Yp+yn=—tsint + cye’ + me! +c3cost + c4sint. < 
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Exercises 


1-4. Given q and v below, determine the test function y, for the differential equation 
q(D)y = f, where Lf = *. 

1. g(s)=s3-s ws)=st+1 

2. g(s) =? —s*-s+1 v(s)=s—1 

3. gs) =s3-—s v(s)=s—2 

4. q(s) =s*—81 v(s)=s?7+9 


5-8. Use the method of undetermined coefficients to find the general solution for 
each of the differential equations given below. 


5. y"-y'=e 

6. vy” —y" + y'—y =4cost 
7. yD — 5y" + 4y = 

8. yYXV-y=e+e7% 


9-14. Use the incomplete partial fraction method to solve the following differential 
equations. 


9. y"—-y=e 

10. y"” —4y” + 4y! = 4te* 
11. y"+4y'=t 

12, yY —5y” + 4y = e* 

13. y”—y"” + y'’—y = 4cost 
14. yO-y=e+e7% 
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4.4 Coupled Systems of Differential Equations 


Suppose L; = qi(D) and Lz = q2(D) are polynomial differential operators of 
order m and n, respectively. A system of two differential equations of the form 


Liy = Aiy2 
Loy2 = A2yV1 (1) 


is an example of a coupled system of differential equations. We assume 4, and A 
are scalars. Typically, there are initial conditions 


wO)=ay, 70) =O, acs yl") 0) = an-1 
y2(0) = bo, yi) =bi, «0, yS PO) = dnt (2) 


each given up to one less than the order of the corresponding differential operator. 
Notice how the solution of one equation becomes the input (up to a scalar multiple) 
of the other. The spring system given in the introduction provides an example 
where L, and L> are both of order 2. It is the goal of this section to show how 
such systems together with the initial conditions can be solved using higher order 
constant coefficient differential equations.” The result is a uniqueness and existence 
theorem. We will then return to the coupled spring problem considered in the 
introduction. 

The solution method we describe here involves a basic fact about the algebra of 
polynomial differential operators. 


The Commutativity of Polynomial Differential Operators 


Just as polynomials can be multiplied and factored, so too polynomial differential 
operators. Consider a very simple example. Suppose gi(s) = s—1 and q2(s) = s—2. 
Then gi(D) = D — 1 and q2(D) = D — 2. Observe, 
(D —1)(D -2)y = (D —- IQ" - 29) 
= (D - l)y’—(D-1)@y) 
= Sy = ey =2y) 


?There are other methods. For example, in the exercises, a nice Laplace transform approach 
will be developed. Theoretically, this is a much nicer approach. However, it is not necessarily 
computationally easier. In Chap. 9, we will consider systems of first order differential equations 
and show how (1) can fit in that context. 
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= y" —3y! + 2y 
= (D’—3D + 2)y =q(D)y, 


where g(s) = s? — 3s +2 = (s — 1)(s — 2). Therefore, g(D) = (D — 1)(D — 2), 
and since there was nothing special about the order, we can also write g(D) = 
(D — 2)(D — 1). More generally, if g(s) = qi(s)q2(s), then the corresponding 
differential operators multiply to give g(D) = q\(D)q2(D). This discussion leads 
to the following commutative principle: If 2; = q,;(D) and Ly = q2(D) are 
polynomial differential operators, then 


LiL. = LoL. 


Extending the Initial Conditions 


Suppose y; and yz are solutions to (1) satisfying the initial values given in (2). 
It turns out then that these equations determine the initial conditions ao (0) and 
y) for allk = 1,2,.... To see this, suppose L; = q\(D) = cy D"+---cyD+ 
co. Now evaluate Ly; = A, y2 at t = 0 to get Ly, (0) = Ay2(0) or 


emy” (0) + en" 20) +... coy (0) = Ary2(0). 


Since all initial values except ye (0) are known, we can solve for x (0), Hence, 


let dm = ye (0) be the unique solution to ZL; y,;(0) = A, y2(0). Now differentiate 
the equation L;y; = A, y2 and evaluate at tf = 0 to get 


CmV "TY (0) + Cm—1y™ (0) +... coy} (0) = Ary; (0). 


Now, all initial values except y’"t) (0) are known. We define a4, = y""*)(0) 
to be the unique solution to DL, y,(0) = A; Dy2(0). We can repeat this procedure 
recursively up to the (n — 1)st derivative of y to get dy, = ye (0). .5 Apt = 


[ea (0) where a, +, is the unique solution to 
D‘L yi (0) = A1D* y2(0). 


: a cot way, we can recursively extend the initial values of y2 to get 

b, = = 9, () (0),... Pn-tm— l= aa °) where b+, is the unique solution to 
D*Lyy(0) = aD* yi (0). It is important to notice that this procedure does not 
actually depend on explicitly knowing the functions y; and yo: the values of ay+5 
and b,,4, only depend on the recursive solutions to D‘L 1¥1(0) = A, Dy2(0) and 
D*L3y (0) = AD y(0), respectively. It is also useful to observe that since the 
values of a; = y“@) and b, = ys (0) are now known fork = 0,...,.2+m-—1, 
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we can repeat the recursion process indefinitely to compute all higher order values 
of a, and b,. The key thing to note is that a, and by are the (recursive) solutions to 


D*‘L,y\(0) =A,D* y.(0) and D*L,y,(0) = A, D* y2(0), (3) 


respectively. 
The following example illustrates the process outlined above. 


Example 1. Consider the coupled system of differential equations 


y(t) + 3y1 (1) = 4yn(t) (4) 
yz (t) + 3y2(t) = 2yi(t), (5) 


with initial conditions y,\(0) = 3, y2(0) = 1, and y5(0) = 3. Determine the 
extended initial values yO) and yo (0), fork = 0,...,4. 


> Solution. We evaluate (4) att = 0 to get y;(0) + 3y1(0) = 4)2(0). Since 
yi(0) = 3 and y2(0) = 1, it follows that y;(0) = —5. Apply D to (4) att = 0 to 
get y//(0) + 3y)(0) = 4y5(0). Since y| (0) = —5 and y5(0) = 3, we get y/(0) = 
27. Now evaluate (5) at t = 0 to get y/(0) + 3y2(0) = 2y,(0). It follows that 
ys (0) = 3. Apply D to (5) att = 0 to get yf’(0) + 3y5(0) = 2y) (0) which gives 
y’(0) = —19. Apply D? to (5) at t = 0 to get yf? (0) + 3y¥(0) = 2y/(0) which 
implies y (0) = 45. Now apply D? to (4) att = 0 to get y/"(0) + 3y/(0) = 
4y (0) which implies y/”(0) = —69. Finally, apply D? to (4) at t = 0 to get 
yO) + 3yl"(0) = 4yf’(0) which implies y\(0) = 131. The following table 
summarizes the data obtained. 


yi (0) = 3 y2(0) = 1 
yi (0) = —5 y(0) = 3 
y{ (0) = 27 AC ee! 
yi’ (0) = -69 yz (0) = -19 
y,?(0) = 131 y$? (0) = 45. (6) 


With patience, it is possible to compute any initial value for y, or yy att =0. < 
We are now in a position to state the main theorem. 


Theorem 2. Suppose L, and Lz are polynomial differential operators of order m 
and n, respectively. The unique solution (y1, y2) to the coupled system of differential 
equations 
Livi =A1y2 (7) 
Layo = A2y1 (8) 
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with initial conditions 


yi(0)=ao, yi(O)=a1, ..., yO) = amt 
y2(0) = bo, y5(0) =i, ..., yO) = byt (9) 


is given as follows: Extend the initial values ax and bx, fork = 1,...n +m-—1, 
as determined by (3). Let L = L,L2—A,A2. Then y, and y2 are the homogeneous 
solutions to Ly = 0 with initial conditions yO) = ax and y (0) =h,k = 
0,...,n +m — 1, respectively. 


Proof. First, let us suppose that (yi, y2) is a solution to the coupled system and 
satisfies the given initial conditions. Then y; and y2 satisfy the initial conditions 
given by (3). Now apply L> to (7) and L, to (8) to get 


LoLyy, = A, Loy2 = AA2y1 
LE, Layo = AgL yy) = AjA2y2. 


Both of these equations imply that y; and y2 are solutions to Ly = 0, where L = 
LiL, — 4,2, satisfying the initial conditions a, = yo) and by = y(0), 
k = 0,...,n +m -—1. By the uniqueness part of Theorem 5 of Sect. 4.1, y, and 
y2 are uniquely determined. To show that solutions exist, suppose y; and y> are the 
solutions to L y = 0 with initial conditions (obtained recursively) a, = yo (0) and 
by = yO), k = 1,2,...,n +m —1. We will show that L;y; = A,y2. The 
argument that Ly. = A, y, is similar. Let z,} = LZ, y, and z = A, y2. Then 


Ly Loz = Ly Ly Loy, = Ayah yy = AA 
L\Lo2 = AL, Lay2 = AAjAay2 = AjArz2 


It follows that z; and z) are homogeneous solutions to Ly = 0. By (3), z; and z 
satisfy the same initial values for all k = 0,...,2 +m —1. By the existence and 
uniqueness theorem, Theorem 5 of Sect. 4.1, we have z; = Zo. oO 


Algorithm 3. Suppose L, and L> are polynomial differential operators of order m 
and n, respectively. Then the solution to (1) with initial conditions given by (2) is 
given by the following algorithm: 


Solution Method for Coupled Systems 


1. Extend (recursively) the initial conditions yo) and ye (0), fork = 
1,2,....n+m-—1. 
2. Let L = L,L.—,A2 and solve 


for each set of initial conditions. 
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Example 4. Solve the following coupled system: 


y, + 31 = 4y2 
yz + 3y2 = 2y1, 


yi(0) = 3, y2(0) = 1, and y5(0) = 3. 

> Solution. In Example 1, we extended the initial values (see (6), where we will 

only need the first 3 rows). We let 2; = D+3 and L, = D? +3. Then y; and y2 are 

homogeneous solutions to L = L;L,—8 = D?+ 3D*+3D +1. The characteristic 

polynomial is g(s) = s? + 35° + 3s + 1 = (s + 1)?. Since By = {ete 1?e"} 

it follows that the homogeneous solutions take the form 
y=cye! +eote’ +03t7e%. 

To find y;, we set y) = cye! +c?te +c3e'. We compute y; and y/’ and substitute 

the initial conditions y;(0) = 3, y;(0) = —5, and y//(0) = 27 to get the following 

system: 


Cl = 3 
—c1 + C2 =—5 
CQ = 2c + 203 = 27; 
A short calculation gives c; = 3, cp = —2, and c3 = 10. It follows that y,(¢) = 


(3 — 2t + 10t7)e™. In a similar way, setting y2 = cje! + c?te + c3e~ leads to 
the system 


Cy =1 


—C; + © 
Cg = 2c + 203 ='3. 


A short calculation gives c; = 1, cp = 4, andc3 = 5, and hence, y2(t) = (1+ 4t+ 
5t7)e". It follows that 


yi(t) = (3—2t+1007)e* and yo(t) = (1+ 4t + 5t7)e7 


are the solutions to the coupled system. < 


Coupled Spring Systems 


We now return to the problem posed at the beginning of this chapter. Two springs 
systems (without dashpots) are coupled as illustrated in the diagram below: 
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My ae 


If y; and yz denote the displacements of the bodies of mass m, and m2 from their 
equilibrium positions, y; = 0 and yz = 0, then we showed that y; and y2 satisfy 


myyy (t) + (ki + ko) y(t) = kaya(t) 
m2y3(t) + kayo(t) = kayi(t). (10) 


If we divide each equation by the leading coefficient and let 


k k k 
a=—, b=, and c=, (11) 
my, mM m2 
then we get the coupled system 
Ly: = by, (12) 
Loy. = cy, (13) 


where L; = D? +a+b and L> = D? +c. We observe that 


L=L1,L,.—be 
= D¢+(a+b+c)D? +ac. 


As to initial conditions, suppose we are given that y)(0) = Ao, y;(0) = Aj, 
y2(0) = Bo, and y5(0) = By. Then (12) and its derivative imply 


y{ (0) = —(a + b) yi, (0) + by2(0) = —(a +b) Ao + DBo 
yi (0) = —(a + b) y{ (0) + by3(0) = —(a +b) A, + DB. 
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In a similar way, (13) implies 


y3 (0) = —cy2(0) + cyi(0) = —cBo + cAg 
y3' (0) = —cy3(0) + cy, (0) = —cB, + cA). 


Summarizing, we obtain that y; and y2 both satisfy the same 4th order differen- 
tial equation 


yO+@+b+e)y" tacy =0 (14) 
with initial conditions 
yi(0) = Ao y2(0) = Bo 
yi, (0) = A y3(0) = By 
yi (0) = —(a + b) Ao + bBo y3 (0) = —cBo + cAo 
yi (0) = -(a+ b)A; + DB, ys’ (0) = —cB, + cA}. (15) 


Example 5. Consider the coupled spring system with m; = 3, m2 = 4,k, = 9, 
and ky = 12. Att = 0, both masses are pulled downward a distance of 1m from 
equilibrium and released without imparting any momentum. Determine the motion 
of the system. 


> Solution. From (11), we get 


9 12 12 
a=—=3, b= =4, and c=— =3. (16) 
3 3 4 


Thus, y; and yz satisfy the following coupled system of differential equations: 


yi + 7y1 = 4y2 
yy + 3y2 = 3y1. 


By Theorem 2, y; and y2 are homogeneous solutions to the 4th degree equation 
q(D)y = 0 where q(s) = (s?+7)(s?+3)—12 = s*+10s2+9 = (s?+1)(s?+9). 
It follows that y, and y are linear combinations of B, = {cos t, sint, cos 3¢, sin 3f}. 
By (15), the initial conditions of y,; and yz at t = 0 up to order 3 are 


yi(0) = 1 y2(0) =1 
V0) = 0  y$0) =0 
yi) =-3 yf) =0 
Vi'O= 0 y'O)=0. 


Therefore, if y; = c; cost + c2sint + c3 cos 3t + c4 sin 3¢, then the coefficients 
satisfy 
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cq o+ C3 = 1 
() + 3c, = 0 
—c; + —903 = -3 
—C2 —27c4= 0 


from which we get cy = ;, 2=0,03= 7 and c4 = 0. It follows that 


3 1 
y(t) = 7 cost + 4098 3t. 


On the other hand, if yo = c; cost + c2sint + c3cos3t + c4sin3t, then the 
coefficients satisfy 


cy + C3 = 1 
C2 + 3c4 =0 
=C1 F —9c3 =0 
-—C2 — 27c4 = 0 
from which we get cy = 2, 2=0,93= 4) and c4 = 0. It follows that 


9 1 
y2(t) = oo - oe 


Since y, and y are periodic with period 27, the motion of the masses (given below) 
are likewise periodic. Their graphs are simultaneously given below. 


>< 


4.4 Coupled Systems of Differential Equations 
Exercises 


1-8. Solve the following coupled systems. 


1. 
y, — 691 = —4y2 
yg = 2y1 


with initial conditions y;(0) = 2 and y2(0) = —1. 


y, — 3y1 = —4y2 
yty=N 


with initial conditions y;(0) = 1 and y2(0) = 1. 


yi = 2y2 
yy = —2y1 


with initial conditions y;(0) = 1 and y2(0) = —1. 


¥, —2y1 = 2y2 
yz + 2y3 + y2 = —2y1, 


with initial conditions y;(0) = 3, y2(0) = 0, and y3(0) = 3. 


yi +4y1 = 10y2 
yy — 6y5 + 23y2 


91, 


with initial conditions y;(0) = 0, y2(0) = 2, and y3(0) = 2. 


y, —2y1 = —2y2 
yz + ¥) + 6y2 = 4y1, 


with initial conditions y;(0) = 1, y2(0) = 5, and y3(0) = 4. 
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y, + 2y, + 6y1 = 5yo 
yz — 2y, + 6y2 = 9y1, 


with initial conditions y;(0) = 0, y; (0) = 0, y2(0) = 6, and y5(0) = 6. 
8. 


yt +291 = —3y2 


Yq + 2y2— 9y2 = 6y1, 
with initial conditions y;(0) = —1, y;(0) = —4, y2(0) = 1, and y4(0) = 2. 
9-10. Solve the coupled spring systems for the given parameters m), m2, k,, and 


k» and initial conditions. 


9. m, = 2,m2. = 1,k, = 4, and ky = 2 with initial conditions y;(0) = 3, 
y, (0) = 3, y2(0) = 0, and y3(0) = 0 

10. my = 4,m3 = 1,k,; = 8, and ky = 12 with initial conditions y,(0) = 1, 
y} (0) = 0, y2(0) = 6, and y5(0) = 0 


11. The Laplace Transform Method for Coupled Systems: In this exercise, we will 
see how the Laplace transform may be used to solve a coupled system: 


Liyi = A1y2 
Loy2 = A2y1 
with initial conditions 
yi) =a, yiO)=a, ..., yO) =an-1 
y2(0) = bo, yO) =b1, «20, yf PO) = dy. 


Let L; = q,(D) and Ly = q2(D) be polynomial differential operators. Let 
Y; = £L{yi} and ¥Y2 = L {yo}. Suppose £ {Li y1} (s) = qi(s)¥i(s) — pis) and 
L{Loy2} (8) = qo(s)¥2(s) — p(s), where pi(s) and p2(s) are polynomials 
determined by the initial conditions. 


1. Show that Y; and Y> satisfy the following matrix relation: 


tes |) ee = feed. 
—A2 qr(s)} \Yo(s) p2(s)) 
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2. Show that this system has a solution given by 


¥\(s) = Pi(8)q2(s) + A1 pr(s) 
qi(s)q2(s)— Arad” 
P2(s)qi(s) + Arpi(s) 


qi(s)g2(s) — AjAz 


Yo(s) = 


12-16. Use the Laplace transform method developed in Exercise 11 to solve the 
following coupled systems. 


12. 
yy =—J2 
y2-2M = 
with initial conditions y;(0) = 1 and y2(0) = —1. 
13. 
WA y= =2y2 
¥y—Y2 = 2M 
with initial conditions y;(0) = 2 and y2(0) = —2. 
14. 
y, —2y1 = —y2 
Ya-Ytw=y 
with initial conditions y;(0) = 0, y2(0) = —1, and y4(0) = 2. 
15. 
yi + 2y1 = 5y2 
yy — 295 + 5y2 = 2y1 
with initial conditions y;(0) = 1, y2(0) = 0, and y}(0) = 3. 
16. 


yy +2y1 = —3y2 
yz + 23 —9y2 = 6" 


with initial conditions y,;(0) = 10, y; (0) = 0, y2(0) = 10, and y5(0) = 0. 
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4.5 System Modeling 


Mathematical modeling involves understanding how a system works mathemati- 
cally. By a system, we mean something that takes inputs and produces outputs such 
as might be found in the biological, chemical, engineering, and physical sciences. 
The core of modeling thus involves expressing how the outputs of a system can be 
mathematically described as a function of the inputs. The following system diagram 
represents the inputs coming in from the left of the system and outputs going out on 
the right. 


f(t) = — y(t) 


For the most part, inputs and outputs will be quantities that are time dependent; they 
will be represented as functions of t. There are occasions, however, where other 
parameters such as position or frequency are used in place of time. An input-output 
pair, (f(t), y(¢)), implies a relationship which we denote by 


y(t) = O(f)@). 


Notice that ® is an operation on the input function f and produces the output 
function y. In a certain sense, understanding ® is equivalent to understanding the 
workings of the system. Frequently, we identify the system under study with ® 
itself. Our goal in modeling then is to give an explicit mathematical description 
of @. 

In many settings, a mathematical model can be described implicitly by a constant 
coefficient linear differential equation and its solution gives an explicit description. 
For example, the mixing problems in Sect. 1.5, spring systems in Sect. 3.6, RCL 
circuits in Sect. 3.7, and the coupled spring systems in Sect. 4.4 are each modeled by 
constant coefficient linear differential equations and have common features which 
we explore in this section. To get a better idea of what we have in mind, let us 
reconsider the mixing problem as an example. 


Example 1. Suppose a tank holds 10 liters of a brine solution with initial concen- 
tration a/10 grams of salt per liter. (Thus, there are a grams of salt in the tank, 
initially.) Pure water flows in an intake tube at a rate of b liters per minute and the 
well-mixed solution flows out of the tank at the same rate. Attached to the intake is 
a hopper containing salt. The amount of salt entering the intake is controlled by a 
valve and thus varies as a function of time. Let f(t) be the rate (in grams of salt per 
minute) at which salt enters the system. Let y(t) represent the amount of salt in the 
tank at time ¢. Find a mathematical model that describes y. 


> Solution. As in Chap. 1, our focus is on the way y changes. Observe that 


y’ = input rate — output rate. 
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Salt 


| 


———> 


Pure Water 


By input rate, we mean the rate at which salt enters the system and this is just f(t). 
The output rate is the rate at which salt leaves the system and is given by the product 
of the concentration of salt in the tank, y(t)/10, and the flow rate b. We are thus led 
to the following initial value problem: 


b 
Yorgi. FO=a: (1) 
In this system, f(t) is the input function and y(t) is the output function. Incorpo- 
rating this mathematical model in a system diagram gives the following implicit 
description: 


, b = 
Solve y+ T= f(t) 


f)— HO) =a 


— y(t). 


Using Algorithm 3 in Sect. 1.5 to solve (1) gives 


t " 
y(t) =aew + cf f f(xyeio dx 
0 
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ah(t)+ f * h(t), 


where h(t) = eo and Ff * h denotes the convolution of f with h. We therefore 
atrive at an explicit mathematical model @ for the mixing system: 


@(f)(t) = ah(t) + f * h(t). < 


As we shall see, this simple example illustrates many of the main features shared 
by all systems modeled by a constant coefficient differential equation. You notice 
that the output consists of two pieces: ah(t) and f * h(t). If a = 0, then the initial 
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state of the system is zero, that is, there is no salt in the tank at time ¢ = 0. In this 
case, the output is 


y(t) = O(f)O) = f * ht). (2) 


This output is called the zero-state response; it represents the response of the system 
by purely external forces of the system and not on any nonzero initial condition or 
state. The zero-state response is the particular solution to q(D)y = f, y(0) = 0, 
where g(s) = s + b/10. 

On the other hand, if f = 0, the output is ah(t). This output is called the zero- 
input response; it represents the response based on purely internal conditions of the 
system and not on any external inputs. The zero-input response is the homogeneous 
solution to g(D)y = 0 with initial condition y(0) = a. The total response is the 
sum of the zero-state response and the zero-input response. 

The function h is called the unit impulse response function. It is the zero-input 
response with a = 1 and completely characterizes the system. Alternatively, we can 
understand / in terms of the mixing system by opening the hopper for a very brief 
moment just before tf = 0 and letting 1 gram of salt enter the intake. Att = 0, 
the amount of salt in the tank is 1 gram and no salt enters the system thereafter. 
The expression “unit impulse” reflects the fact that a unit of salt (1 gram) enters the 
system and does so instantaneously, that is, as an impulse. Such impulsive inputs 
are discussed more thoroughly in Chap. 6. Over time, the amount of salt in the tank 
will diminish according to the unit impulse response h = e710’ as illustrated in the 
graph below: 


Once / is known, the zero-state response for an input f is completely determined 
by (2). One of the main points of this section will be to show that in all systems 
modeled by a constant coefficient differential equation, the zero-state response is 
given by this same formula, for some h. We will also show how to find A. 

With a view to a more general setting, let g(D) be an nth order differential 
operator with leading coefficient one and let a = (dp, a,...,@n—1) be a vector of n 
scalars. Suppose @ is a system. We say @ is modeled by q(D) with initial state a if 
for each input function f,, the output function y = ®(f) satisfies g(D)y = f, and 
y(0) = do, y'(0) = ay, ..., y"~ (0) = a,_1. Sometimes we say that the initial 
state of @ is a. By the existence and uniqueness theorem, Theorem 5 of Sect. 4.1, y 
is unique. In terms of a system diagram we have 
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; Solve q(D)y = f 
f(t) — with initial state a — y(t). 


The definitions of zero-state response, zero-input response, and total response 
given above naturally extend to this more general setting. 


The Zero-Input Response 


First, we consider the response of the system with no external inputs, that is, f(t) = 
0. This is the zero-input response and is a result of internal initial conditions of the 
system only. For example, the initial conditions for a spring system are the initial 
position and velocity, and for RCL circuits, they are the initial charge and current. 
In the mixing system we described earlier, the only initial condition is the amount 
of salt a in the tank at time ¢t = 0. 

The zero-input response is the solution to 


q(D)y =0, y(0) = ao, y’(0) = ay,..., yO) = ay_1. 


By Theorem 2 of Sect. 4.2, y is a linear combination of functions in the standard 
basis B,. The roots A;,...,A,% € C of g are called the characteristic values and the 
functions in the standard basis are called the characteristic modes of the system. 
Consider the following example. 


Example 2. For each problem below, a system is modeled by g(D) with initial 
state a. Plot the characteristic values in the complex plane, determine the zero-input 
response, and graph the response. 


.q(D) =D+3,a=2 

. q(D) = (D —3)(D + 3),a= (0,1) 
. q(D) = (D +1)? +4, a = (1,3) 

. q(D) = D? + 4,a= (1,2) 

. q(D) = (D* + 4)’, a = (0, 0,0, 1). 


onandaep 


> Solution. The following table summarizes the calculations that we ask the reader 
to verify. 
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Characteristic Zero-input Graph 
Values Response 
a 
@ :| 
-3 
y = 2e—3t 
b 
© o 
-3 3 
y= = (e3t e—3t) 
c 
-1+2i1 @ 
-1-21 @ 
y =e *(cos(2t) + 2sin(2t)) 
d 
21 @ 
-21 @ 
y = cos(2t) + sin(2t) 
e 
a 
a 
wV 
-2i @2 
y= 7 (2tcos(2t) + sin(2t)) 
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In part (e), we have indicated the multiplicity of +27 by a 2 to the right of the 
characteristic value. < 


The location of the characteristic values in the complex plane is related to an 
important notion called system stability. 


Stability 


System stability has to do with the long-term behavior of a system. If the zero- 
input response of a system, for all initial states, tends to zero over time, then we 
say the system is asymptotically stable. This behavior is seen in the mixing system 
of Example |. For any initial state a, the zero-input response y(t) = ae has 
limiting value 0 as t — oo. In the case a = 2 and b = 30, the graph is the 
same as that given in Example 2a. Notice that the system in Example 2c is also 
asymptotically stable since the zero-input response always takes the form y(t) = 
e'(A sin(2t) + Bcos(2t)). The function t > A sin(2t) + Bcos(2r) is bounded, 
so the presence of e~ guarantees that the limit value of y(t) is 0 as t > oo. In both 
Example 2a and 2c, the characteristic values lie in the left-half side of the complex 
plane. More generally, suppose te’ cos Bt is a characteristic mode for a system. If 
A =a+if anda <0, then 


lim t*e cos Bt = 0, 
too 


for all nonnegative integers k. A similar statement is true for te®’ sin Bt. On the 
other hand, if a > 0, then the characteristic modes, t* e“ cos Bt and tke sin Bt, are 
unbounded. Thus, a system is asymptotically stable if and only if all characteristic 
values lie to the left of the imaginary axis. 

If a system is not asymptotically stable but the zero-input response is bounded for 
all possible initial states, then we say the system is marginally stable. Marginal sta- 
bility is seen in Example 2d and occurs when one or more of the characteristic values 
lie on the imaginary axis and have multiplicity exactly one. Those characteristic 
values that are not on the imaginary axis must be to the left of the imaginary axis. 

We say a system is unstable if there is an initial state in which the zero-input 
response is unbounded over time. This behavior can be seen in Example 2b and 2e. 
Over time, the response becomes unbounded. Of course, in a real physical system, 
this cannot happen. The system will break or explode when it passes a certain 
threshold. Unstable systems occur for two distinct reasons. First, if one of the 
characteristic values is A = a+if anda > 0, then A lies in the right-half side of the 
complex plane. In this case, the characteristic mode is of the form te cos Bt or 
t*e*' sin Bt. This function is unbounded as a function of t. This is what happens in 
Example 2b. Second, if one of the characteristic values A = if lies on the imaginary 
axis and, in addition, the multiplicity is greater than one, then the characteristic 
modes are of the form r* cos(Br) or t* sin(Bt), k > 1. These modes oscillate 
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unboundedly as a function of tf > 0, as in Example 2e. Remember, it only takes 
one unbounded characteristic mode for the whole system to be unstable. 


Example 3. Determine the stability of each system modeled by g(D) below: 


1. g(D) = (D + 1)°(D + 3) 

2. q(D) = (D’ + 9)(D + 4) 

3. q(D) = (D + 4)?(D — 5) 

4. q(D) = (D? + 1)(D? + 9) 

> Solution. 1. The characteristic values are A = —1 with multiplicity 2 and A = 
—3. The system is asymptotically stable. 

2. The characteristic values are A = +37 and A = —4. The system is marginally 
stable. 


3. The characteristic values are 1 = —4 with multiplicity 2 and A = 5. The system 
is unstable. 

4. The characteristic values are A = +i and A = +37 with multiplicity 2. The 
system is unstable. < 


The Unit Impulse Response Function 


Suppose ® is a system modeled by q(D), an nth order constant coefficient 
differential operator. The unit impulse response function h(t) is the zero-input 
response to ® when the initial state of the system is a = (0,...,0,1). More 
specifically, h(t) is the solution to 


q(D)y=0 y(0)=0,...,y" 2) = 0, y* (0) = 1. 


Ifm = 1, then y(0) = 1 as in the mixing system discussed in the beginning of this 
section. In this simple case, h(t) is a multiple of a single characteristic mode. For 
higher order systems, however, the unit impulse response function is a homogeneous 
solution to q(D)y = 0 and, hence, a linear combination of the characteristic modes 
of the system. 


Example 4. Find the unit impulse response function for a system ® modeled by 
q(D) = (D + 1)(D* + 1). 
> Solution. It is an easy matter to apply the Laplace transform method to 


q(D)y = 0 with initial condition y(0) = 0, y’(0) = 0, and y”(0) = 1. We get 
q(s)Y(s) — 1 = 0. A short calculation gives 
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(ose ! _1f 2, -2s+2 
@ == a =a(st =). 


The inverse Laplace transform is y(t) = s(e7 + sint — cost). The unit impulse 
response function is thus 


1 
h(t) = ek + sint — cost). < 


Observe in this example that A(t) = £7! \as} (t). It is not hard to see that this 


formula extends to the general case. We record this in the following theorem. The 
proof is left to the reader. 


Theorem 5. Suppose a system ® is modeled by a constant coefficient differential 
operator q(D). The unit impulse response function, h(t), of the system ® is given by 


ee 


The Zero-State Response 


Let us now turn our attention to a system @ in the zero-state and consider the zero- 
state response. This occurs precisely when a = 0, that is, all initial conditions 
of the system are zero. We should think of the system as initially being at rest. 
We continue to assume that ® is modeled by an nth order constant coefficient 
differential operator g(D). Thus, for each input f(t), the output y(t) satisfies 
q(D)y = f with y and its higher derivatives up to order n — 1 all zero at t = 0. 
An important feature of @ in this case is its linearity. 


Proposition 6. Suppose ® is a system modeled by q(D) in the zero-state. Then ® 
is linear. Specifically, if f, f\, and fy are input functions and c is a scalar, then 


1. (fi + fr) = P(fi) + Pf) 

2. (cf) =cP(f). 

Proof. If f is any input function, then (f/f) = y if and only if g(D)y = f and 
y(0) = y'(0) = ++» = y""Y(O) = 0. If y; and y» are the zero-state response 
functions to f, and f), respectively, then the linearity of g(D) implies 


q(D)(11 + y2) = q(D)y1 + q(D)y2 = fi + fr. 


Furthermore, since the initial state of both y, and y2 are zero, so is the initial state 
of y; + y2. This implies (f; + fo) = yi + yz. Ina similar way, 
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q(D)(cy) = cq(D)y = cf, 


by the linearity of q(D). The initial state of cy is clearly zero. So (cf) = c®(f). 
oO 


The following remarkable theorem gives an explicit formula for ® in terms of 
convolution with the unit-impulse response function. 


Theorem 7. Suppose ® is a system modeled by q(D) in the zero-state. If f is a 
continuous input function on an interval which includes zero, then the zero-state 
response is given by the convolution of f with the unit impulse response function h. 
That is, 


O(/)\(t) = f x h(t) = i flat — x) dx. 


If, in addition, we were to assume that f has a Laplace transform, then the proof 
would be straightforward. Indeed, if y(t) is the zero-state response, then the Laplace 
transform method would give q(s)£L {y} = L{f} := F(s) and therefore 


1 
Liy}(s) = ae 


The convolution theorem then gives y(t) = O(f)(t) =hx« f. 
For the more general case, let us introduce the following helpful lemma. 


Lemma 8. Suppose f is continuous on a interval I containing 0. Suppose h is 
differentiable on I. Then 


(f *hy(t) = f(OhO) + f *h. 
Proof. Let y(t) = f * h(t). Then 


Ay _ y+ At)—y() 


At At 
1 t+At t 
= al flsyhte + At xyae— f Flynt ~ xa) 
mn i h(t + At —x)—h(t —x) 
=| fe 2 dx 
t+At 
ig F(x)h(t + At — x) dx. 


We now let Ar go to 0. The first summand has limit i S(x)h'(t —x)dx = f x 
h'(t). By the fundamental theorem of calculus, the limit of the second summand is 
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obtained by evaluating the integrand at x = ¢, thus getting f(t)h(0). The lemma 
now follows by adding these two terms. Oo 


Proof (of Theorem 7). Let h(t) be the unit impulse response function. Then 
h(O) = h’'(0) = --- = h’-Y(0) = O and h@-Y(O) = 1. Set y(t) = f * h(t). 
Repeated applications of Lemma 8 to y gives 


y= fal +hO)f = fehl 
yl = feh" +H Of = f *h" 


yo = f * ce) As h"- (0) f _ i * ne-) 
y™ = fx Ao 4 h°YO) f = fx AD 4 7, 


From this it follows that 


q(D)y=fxq(Dh+f=f 


since gq(D)h = 0. It is easy to check that y is in the zero-state. Therefore, 
O(fy)=y=f xh. o 


At this point, let us make a few remarks on what this theorem tells us. The most 
remarkable thing is the fact that ® is precisely determined by the unit impulse 
response function h. From a mathematical point of view, knowing 4 means you 
know how the system ® works in the zero-state. Once h is determined, all output 
functions, that is, system responses, are given by the convolution product, f * h, for 
an input function f. Admittedly, convolution is an unusual product. It is not at all 
like the usual product of functions where the value (or state) at time ¢ is determined 
by knowing just the value of each factor at time t. Theorem 7 tells us that the state 
of a system response at time ¢ depends on knowing the values of the input function 
f for all x between 0 and t. The system “remembers” the whole of the input f up 
to time ¢ and “meshes” those inputs with the internal workings of the system, as 
represented by the impulse response function h, to give f * h(t). 

Since the zero-state response, f * h, is a solution to q(D)y = f, with zero 
initial state, it is a particular solution. In practice, computing convolutions can be 
time consuming and tedious. In the following examples, we will limit the inputs to 
functions in € and use Table C.7. 


Example 9. A system @ is modeled by g(D). Find the zero-state response for the 
given input function: 
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(a) q(D) = D + 2and f(t) = 1 
(b) q(D) = D? +. 4D +3 and f(t) =e 
(c) q(D) = D* + 4and f(t) = cos(2r) 


> Solution. (a) The characteristic polynomial is g(s) = s + 2, and therefore, 
the characteristic mode is e~*’. It follows that h(t) = Ae~?! and with initial 
condition h(0) = 1, we get h(t) = e~*’. The system response, y(t), for the 
input | is 


y(t) =e * 1(t) = tl —e 7), 


(b) The characteristic polynomial is g(s) = s* + 4s +3 = (s + 1)(s + 3). The 
characteristic modes are e~* and e~’. Thus, /(t) has the form h(t) = Ae + 


Be, The initial conditions h(0) = 0 and h’(0) = 1 imply 


wm 


h(t) = se —e *). 


The system response to the input function f(t) = e~ is 


1 1 1 1 
is Set ae) ere S Beet = t 
yt) = 5 e')*e = aie ae Ae 


3t 


(c 


wm 


It is easy to verify that the impulse response function is h(t) = 5 sin(2t). The 
system response to the input function f(t) = cos(2r) is 


1 1 
y(t) = 5 sin(2t) * cos(2t) = a sin(2r). < 


Bounded-In Bounded-Out 


In Example 9a, we introduce a bounded input, f(t) = 1, and the response 
y(t) = $(1 —e~*') is also bounded, by 5, in fact. On the other hand, in Example 9c, 
we introduce a bounded input, f(t) = cos2t, yet the response y(t) = it sin 2t 
oscillates unboundedly. We say that a system ® is BIBO-stable if for every bounded 
input f(t) the response function y(t) is likewise bounded. (B/BO stands for 
“bounded input bounded output.”) Note the following theorem. An outline of the 
proof is given in the exercises. 


Theorem 10. Suppose ® is an asymptotically stable system. Then ® is BIBO- 
stable. 


Unstable systems are of little practical value to an engineer designing a “safe” 
system. In an unstable system, a set of unintended initial states can lead to an 
unbounded response that destroys the system entirely. Even marginally stable 
systems can have bounded input functions that produce unbounded output functions. 
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This is seen in Example 9c, where the system response to the bounded input 
f(t) = cos(2t) is the unbounded function y(t) = at sin(2t). Asymptotically stable 
systems are thus the “safest” systems since they are BJBO-stable. They produce at 
worst a bounded response to a bounded input. However, this is not to say that the 
response cannot be destructive. We will say more about this in the following topic. 


Resonance 


We now come to a very interesting and important phenomenon called resonance. 
Loosely speaking, resonance is the phenomenon that occurs when a system reacts 
very energetically to a relatively mild input. Resonance can sometimes be catas- 
trophic for the system. For example, a wine glass has a characteristic frequency at 
which it will vibrate. You can hear this frequency by rubbing your moistened finger 
around the rim of the glass to cause it to vibrate. An opera singer who sings a note at 
this same frequency with sufficient intensity can cause the wine glass to vibrate so 
much that it shatters. Resonance can also be used to our advantage as is familiar to 
a musician tuning a musical instrument to a standard frequency given, for example, 
by a tuning fork. Resonance occurs when the instrument is “in tune.” 

The characteristic values of a system ® are sometimes referred to as the 
characteristic frequencies As we saw earlier, the internal workings of a system 
are governed by these frequencies. A system that is energized tends to operate at 
these frequencies. Thus, when an input function matches an internal frequency, the 
system response will generally be quite energetic, even explosive. 

A dramatic example of this occurs when a system is marginally stable. Consider 
the following example. 


Example 11. A zero-state system ® is modeled by the differential equation 


(D? + ly = f. 


Determine the impulse response function / and the system response to the following 
inputs: 


1. f(t) = sin(xt) 
2. f(t) = sin(1.25t) 
3. f(t) = sin(t). 


Discuss the resonance that occurs. 


> Solution. The characteristic values are +i with multiplicity one. Thus, the 
system is marginally stable. The unit impulse response A(t) is the solution to 
(D? + 1)y = 0 with initial conditions y(0) = 0 and y/(0) = 1. The Laplace 


transform gives H(s) = = , and hence, h(t) = sin(f). 
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Fig. 4.1 Input and response functions with dissimilar frequencies 


The three inputs all have amplitude 1 but different frequencies. We will use the 
convolution formula 


a sin(bt) — b sin(at) 


i : a* — b? es 
sin(at) * sin(bt) = ¢ 
sin(at) — at cos(at) ; 
ifa=b 
2a 
from Table 2.11. 
1. Consider the input function f(t) = sin(z?f); its frequency is 2. The system 


response is 
x sin(t) — sin(zf) 
m2—1] 


y(t) = sin(zf) * sin(t) = 


The graph of the input function together with the response is given in Fig. 4.1. 
The graph of the input function is dashed and has amplitude | while the response 
function has an amplitude less than 1. No resonance is occurring here, and this 
is reflected in the fact that the inputs characteristic frequency, z, is far from the 
systems characteristic frequency 1. We also note that the response function is not 
periodic. This is reflected in the fact that the quotient of the frequencies | = 2 
is not rational. We will say more about periodic functions in Chap. 6. 

2. Next we take the input function to be f(t) = sin(1.25r). Its frequency is 1.25 
and is significantly closer to the characteristic frequency. The system response is 


1.25 sin(t) — sin(1.1f) 


t) = sin(1.25t in(t) = 
y(t) = sin( ) * sin(t) 0.5605 


The graph of the input function together with the response is given in Fig. 4.2. 
In this graph, we needed to scale back significantly to see the response function. 
Notice how the amplitude of the response is significantly higher than that of the 
input. Also notice how the response comes in pulses. This phenomenon is known 
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Fig. 4.2 Input and response functions with similar yet unequal frequencies. Beats occur 


Fig. 4.3 Input and response functions with equal frequencies. Resonance occurs 


as beats and is familiar to musicians who try to tune an instrument. When the 
frequency of vibration of the string is close but not exactly equal to that of the 
tuning fork, one hears a pulsating beat. The instrument is out of tune. 

3. We now consider the input function f(t) = sint. Here the input frequency 
matches exactly the characteristic frequency. The system response is 


sin(t) — t cos(t) 


y(t) = sin(t) * sin(t) = 5 


The presence of ¢ in ¢ cos(t) implies that the response will oscillate without 
bound as seen in Fig. 4.3. 


Again in this graph, we needed to scale back to see the enormity of the response 
function. This is resonance in action. In physical systems, resonance can be so 
energetic that the system may fall apart. Because of the significant damage that can 
occur, systems designers must be well aware of the internal characteristic values 
or frequencies of their system and the likely kinds of inputs it may need to deal 
with. < 
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Fig. 4.4 Asymptotically stable system with resonance 


As a final example, we consider resonance in an asymptotically stable system. 


Example 12. A zero-state system ® is modeled by the differential equation 
(D+01P +)y =f. 


Determine the impulse response function / and the system response to the input 
function f(t) = e~°"' cos(t). Discuss the resonance that occurs. 


> Solution. The characteristic values are —0.1 + i and lie in the left-hand side of 
the complex plane. Thus, the system is asymptotically stable. The characteristic 
modes are {e~°'’ sint,e~°"" cost}. A straightforward calculation gives the unit 
impulse response function 


h(t)) =e °" sin(t). 


The input function f(t) = e~°! cos(t) is a characteristic mode, and the response 
function is 


y(t) =h* f(t) = set sin(f). 


Figure 4.4 shows the graph. Notice the initial energetic response. This is a 
manifestation of resonance even though the response dies out in time. If the response 
passes a certain threshold, the system may break. On the other hand, resonance can 
be used in a positive way as in tuning a radio to a particular frequency. Again, system 
designers must be well aware of the resonance effect. < 
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Exercises 


1-12. For each problem, a system is modeled by g(D) with initial state a. 
Determine the zero-input response. Determine whether the system is asymptotically 
stable, marginally stable, or unstable. 


1. q((D) = D+5,a=10 


2. q(D) = D-2,a=2 

3. gq(D) = D? — 4D +3,a= (2,4) 

4. q(D) = D? +5D + 4,a= (0,3) 

5. q(D) = D? + 4D +5,a= (0,1) 

6. g(D) = D? + 9,a= (1,1) 

7. q(D) = D?+ 6D + 9,a= (1,1) 

8. g(D) = D? + D —2,a= (1,-2) 

9. q(D) = D? -2D + 2,a= (1,2) 

10. q(D) = D? + D’,a= (1,-1,1) 

11. q(D) = (D + 1)(D? + 1),a= (1,-1, 1) 


12. q(D) = D*—1,a= (0,1,0,-1) 


13-17. For each problem, a system is modeled by g(D). Determine the unit impulse 
response function. 


13. g/D)=D+1 
14. q(D) = D* +4 
15. q(D) = D?-4 
16. gq(D) = D?+2D4+5 
17. q(D) = D?+D 


18-20. In this set of problems, we establish that an asymptotically stable system 
modeled by g(D), for some constant coefficient differential operator, is BIBO- 
stable. 


18. Let k be a nonnegative integer and a € R. Show that 


t 
j, xk e®* dx = C + pte”, 
0 


where C is a constant and p(t) is a polynomial of degree k. Show that C + 
p(t)e™ is a bounded function of [0, 00) if a < 0. 

19. Suppose A = a + if is acomplex number and a < 0. Let & be a nonnegative 
integer and suppose f is a bounded function on [0, 00). Show that te” cos Bt x 
f and t*e” sin Bt * f are bounded functions. 

20. Suppose a system modeled by a constant coefficient differential operator is 
asymptotically stable. Show it is B/BO-stable. 


Chapter 5 
Second Order Linear Differential Equations 


In this chapter, we consider the broader class of second order linear differential 
equations that includes the constant coefficient case. In particular, we will consider 
differential equations of the following form: 


ax(t)y” + a(t)y’ + ao(t)y = f(t). (1) 


Notice that the coefficients ao(t), ai (t), and a2(t) are functions of the independent 
variable ¢ and not necessarily constants. This difference has many important 
consequences, the main one being that there is no general solution method as in 
the constant coefficient case. Nevertheless, it is still linear and, as we shall see, this 
implies that the solution set has a structure similar to the constant coefficient case. 

In order to find solution methods, one must put some rather strong restrictions on 
the coefficient functions ao(t), a, (t) and a2(t). For example, in the following list, 
the coefficient functions are polynomial of a specific form. The equations in this list 
are classical and have important uses in the physical and engineering sciences. 


ty” +ty’+(t?—-v?)y =0 Bessel’s equation of index v 
ty” + (1-t)y’+Ay =0 Laguerre’s equation of index 
(1—2*)y” —2ty’ +a(a+ ly =0 Legendre’s equation of index a 
(1—t?)y” —ty’+e0’?y =0 Chebyshev’s equation of index a 
y” —2ty’ + 2Ay =0 Hermite’s equation of index A. 


Unlike the constant coefficient case, the solutions to these equations are not, in 
general, expressible in terms of algebraic combinations of polynomials, trigono- 
metric, or exponential functions, nor their inverses. Nevertheless, the general theory 
implies that solutions exist and traditionally have been loosely categorized as special 
functions. In addition to satisfying the differential equation for the given index, 
there are other interesting and important functional relations as the index varies. We 
will explore some of these relations. 
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5.1 The Existence and Uniqueness Theorem 


In this chapter, we will assume that the coefficient functions do(t), a, (t), and a(t) 
and the forcing function f(t) are continuous functions on some common interval 
I. We also assume that a2(t) # 0 for all t € J. By dividing by a2(t), when 
convenient, we may assume that the leading coefficient function is 1. In this case, 
we say that the differential equation is in standard form. We will adopt much of the 
notation that we used in Sects. 3.1 and 4.1. In particular, let D denote the derivative 
operator and let 


L = ay(t)D* +. a,(t)D + ao(t). (1) 


Then (1) in the introductory paragraph can be written as Ly = f.If f = 0, then the 
equation Ly = f = 0 is called homogeneous. Otherwise, it is nonhomogeneous. 
We can think of L as an operation on functions. If y € C*(Z), in other words if y 
is a function on an interval J having a second order continuous derivative, then Ly 
produces a continuous function. 


Example 1. Suppose L = tD? + 2D +t. Find 
t int 
L (=) iL (=) | L(sint), and L(e~). 


> Solution. The following table gives the first and second derivatives for each 
function: 


cost , _ —tsint —cost »  —t? cost + 2tsint + 2cost 
a na = 13 

sin t ; t cost — sint i —t* sint —2tcost + 2sint 
carn alos ae i 7 
y = sint y’ = cost y” = —sint 
y=et y= -e* yl =e, 


It now follows that 


cost —t* cost + 2t sint + 2cost —t sint — cost cost 
° L t +2 +t 


t 8 t2 
—t> cost + 2t? sint + 2tcost — 2t? sint —2t cost + ft? cost 
= re 
= 0 
sin t —t*? sint —2tcost + 2sint t cost — sint sin t 
° L =t +2 +t 
t 3 t? 
—t3 sint —2t? cost + 2tsint + 2t? cost —2tsint + f? sint 
3 


=0 
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« L(sint) = t(—sint) + 2(cost) +f sint = 2cost 
© L(e*) = te’ +2(-e")+ te = (2t-2)e% < 


The most important general property that we can say about L is that it is linear. 


Proposition 2. The operator 
L =a)(t)D* +a\(t)D + ao(t) 


given by (1) is linear. Specifically, 


1. If y, and yz have second order continuous derivatives, then 


L(y + y2) = L(y) + Lz). 


2. If y has a second order continuous derivative and c is a scalar, then 
L(cy) =cL(y). 


Proof. The proof of this proposition is essentially the same as the proof of 
Proposition 2 of Sect. 3.3. We only need to remark that multiplication by a function 
a;.(t) preserves addition and scalar multiplication in the same way as multiplication 
by a constant. oO 


We call L a second order linear differential operator. Proposition 4 of Sect. 3.3 
and Theorem 6 of Sect.3.3 are two important consequences of linearity for the 
constant coefficient case. The statement and proof are essentially the same. We 
consolidate these results and Algorithm 7 of Sect. 3.3 into the following theorem: 


Theorem 3. Suppose L is a second order linear differential operator and y, and y2 
are solutions to Ly = 0. Then cy y1 + C22 is a solution to Ly = 0, for all scalars 
cy and c2. Suppose f is a continuous function. If yp is a fixed particular solution to 
Ly = f and yy is any solution to the associated homogeneous differential equation 
Ly = 0, then 

Y=Ypt Yn 
isa solution to Ly = f. Furthermore, any solution to Ly = f has this same form. 
Thus, to solve Ly = f, we proceed as follows: 


1. Find all the solutions to the associated homogeneous differential equation 
Ly =0. 

2. Find one particular solution yp. 

3. Add the particular solution to the homogeneous solutions. 
As an application of Theorem 3, consider the following example. 


Example 4. Let L = 1D? +2D +t. Use Theorem 3 and the results of Example 1 
to write the most general solution to 


Ly =2cost. 
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> Solution. In Example 1, we showed that yp = sint was a particular solution and 
y, = cost/t and y. = sint/t are homogeneous solutions. By Theorem 3, we have 


that yn = c1 (s+) +2 (S24) is also a homogeneous solution and 


. cost sin t 
Y=Y)ptYn=sint +c, (=) +a (=) 


are solutions to L y = 2cost. We will soon see it is the general solution. < 


Again, suppose L is a second order linear differential operator and f is a function 
defined on an interval /. Let fg € J. To the equation 


Ly=f 
we can associate initial conditions of the form 
y(to) = yo, and y'(t) = yi. 


We refer to the initial conditions and the differential equation Ly = f as an initial 
value problem. 


Example 5. Let L = tD* + 2D +t. Solve the initial value problem 


Ly =2cost, y(@)=1, y'(@) ==1. 


> Solution. By Example 4, all functions of the form 


: cost sin t 
y=sint Tea a aa 


are solutions. Thus, we only need to find constants c; and c2 that satisfy the initial 
conditions. Since 


j —t sint — cost t cost — sint 
y =cost+c; a ae + C2 er mane © 


we have 
—l 
0+c = + (0) = y@) = 1 
1 —1 j 
Ear Ci + o2(—>) =y'@) =-1, 
4 a 
which imply c; = —z and cp = —1. The solution to the initial value problem is 


. cost sint 
a Sg < 
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In the case where the coefficient functions of LZ are constant, we have an 
existence and uniqueness theorem. (See Theorem 10 of Sect. 3.1.) In the present 
case, we still have the existence and uniqueness theorem; however, its proof is 
beyond the scope of this book.! 


Theorem 6 (Uniqueness and Existence). Suppose ao(t), ai(t), a2(t), and f are 
continuous functions on an open interval I and ax(t) # 0 for allt € I. Suppose 
to € I and yo and y, are fixed real numbers. Let L = az(t)D? +a,(t)D + ao(t). 
Then there is one and only one solution to the initial value problem 


Ly=f, y(to) = yo. y'(to) = i. 


Theorem 6 does not tell us how to find any solution. We must develop procedures 
for this. Let us explain in more detail what this theorem does say. Under the 
conditions stated, the existence and uniqueness theorem says that there always 
is a solution to the given initial value problem. The solution is at least twice 
differentiable on J and there is no other solution. In Example 5, we found y = 


sint — 1S! — “8! is a solution to ty” + 2y’ + ty = 2 cost with initial conditions 
y(z) = 1 and y’(x) = —1. Notice, in this case, that y is, in fact, infinitely 


differentiable on any interval not containing 0. The uniqueness part of Theorem 6 
implies that there are no other solutions. In other words, there are no potentially 
hidden solutions, so that if we can find enough solutions to take care of all possible 
initial values, then Theorem 6 provides the theoretical underpinnings to know that 
we have found ail possible solutions and need look no further. Compare this theorem 
with the discussion in Sect. 1.7 where we saw examples (in the nonlinear case) of 
initial value problems which had infinitely many distinct solutions. 


‘For a proof, see Theorems | and 3 on pages 104-105 of the text An Introduction to Ordinary 
Differential Equations by Earl Coddington, published by Prentice Hall, (1961). 
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Exercises 


1-11. For each of the following differential equations, determine if it is linear 
(yes/no). For each of those which are linear, further determine if the equation is 
homogeneous (homogeneous/nonhomogeneous) and constant coefficient (yes/no). 
Do not solve the equations. 


ly” +y'y=0 

2. y"+y'+y=0 

3. yi+y+y=r? 

4. y”+ty’+(1+??)y? =0 
5. 3t2y” + 2ty’ + y = e* 
6 y+ /y+y=t 

7. y+ J/ty +y=Jt 

8. y’-2y=ty 

9. y’+2y+tsiny =0 
10. y” + 2y’ 4+ (sint)y =0 
11. t?y” + ty’ +(?—5)y =0 


12-13. For the given differential operator L, compute L(y) for each given y. 
12. L=tD?+1 


l. yt) =1 
2. y(t) =t 
3. y(t) =e" 


4. y(t) = cos2t 
13. L=D?+tD-1 


1. y(t) =4 
2. y(t) =1 
3. y(t) =t 
4. yt) =0’ 


14. The differential equation t7y” + ty’—y = 12, t > Ohasa solution of the 
form yp(t) = Cr2. Find C. 

15. The differential equation ty” + (t—1)y’—y = t?e~ has a solution of the form 
yp(t) = Cre. Find C. 

16. Let L(y) = (1+ t?)y"” — 4ty’ + 6y 


1. Check that y(t) = ¢ is a solution to the differential equation L(y) = 2t. 
2. Check that y;(t) = 1 — 3¢? and yo(t) = t — C are two solutions to the 
differential equation L(y) = 0. 
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3. Using the results of Parts (1) and (2), find a solution to each of the following 
initial value problems: 


a. (1+2*)y"”—4ty+6y =2t, y(O)=1, y'(0)=0. 

b. (1 +27)y” —4ty +6y =2t, y(0)=0, y’(0)=1. 

c. (14+ 2*)y”—4ty+6y =2t, y)=—-1, y’O0)=4. 

d. (1+27)y” —4ty+6y =2t, y(0)=a, y'(0) =b, wherea,b ER. 
17. Let L(y) = (t-— ly" —ty’ + y: 


1. Check that y(t) = e~ is a solution to the differential equation L(y) = 
2te™. 

2. Check that y;(t) = e’ and y2(t) = ¢ are two solutions to the differential 
equation L(y) = 0. 

3. Using the results of Parts (1) and (2), find a solution to each of the following 
initial value problems: 


a. (t—ly"”—-ty’+y =2te* y(0)=0, y’(0)=0. 

b. (¢(-1)y’-ty’+y=2te" yO=1, y’0)=0. 

c. (t-—l)y”-ty’+y=2te* yO=0, y(O)=1. 

d. (t—1)y”’-ty’+y =2te%, yO)=a, y’(0)=b,wherea, DER. 
18. Let L(y) = t?y” — 4ty’ + 6y: 


1. Check that y(t) = f° is a solution to the differential equation L(y) = f°. 

2. Check that y,(t) = ¢? and y2(t) = ¢° are two solutions to the differential 
equation L(y) = 0. 

3. Using the results of Parts (1) and (2), find a solution to each of the following 
initial value problems: 


a. t?y"—4ty’+6y=t, y(lI)=1, y’(1)=0. 

b. t?y”—4ty’ + 6y =f, y)=0, y()=1. 

c. ty” —4ty’+6y=Pr, y)=-l, y'(1)=3. 

d. t??y”—4ty’+6y=f°, y(l)=a, y'(1)=b,wherea,beR. 


19-24. For each of the following differential equations, find the largest interval on 
which a unique solution of the initial value problem 


ar(t)y” + ai(t)y' + ao(t)y = fo) 
is guaranteed by Theorem 6, if initial conditions, y(t9) = y1, y’(to) = y1, are given 
at fo. 
19. ?y”+3ty’-y=t* (% =—-1 


1+? 
20. y” —2y’-2y= _ (to = 2) 


5.1 


21, 
22. 
23; 
24. 


25. 


26. 


27. 
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(sint)y” + y=cost (to = F) 

(1+ ?*)y"”—ty’+t?y =cost (t =0) 
y"+Jty’—Vt-3y=0 (f= 10) 
t(t?-4)y"+y=e (t— =1) 


The functions y,(t) = ¢? and y2(t) = f° are two distinct solutions of the initial 
value problem 


t?y” —4ty’+6y =0, y(0)=0, y’(0) =0. 


Why does this not violate the uniqueness part of Theorem 6? 
Let y(t) be a solution of the differential equation 


y” +ai(t)y’ + ao(t)y = 0. 


We assume that a) (ft) and ao(t) are continuous functions on an interval J, so 
that Theorem 6 implies that a solution y is defined on 7. Show that if the graph 
of y(t) is tangent to the f-axis at some point fo of J, then y(t) = O forall t € I. 
Hint: If the graph of y(t) is tangent to the t-axis at (tf, 0), what does this say 
about y(t) and y’ (to)? 

More generally, let y;(¢) and y(t) be two solutions of the differential equation 


y" +ai(t)y’ + ao(t)y = f(t), 


where, as usual, we assume that a;(t), ao(t), and f(t) are continuous functions 
on an interval J, so that Theorem 6 implies that y; and y2 are defined on J. 
Show that if the graphs of y;(¢) and y2(t) are tangent at some point fo of J, 
then y;(¢) = yo(t) forall t € J. 
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5.2 The Homogeneous Case 


In this section, we are concerned with a concise description of the solution set of the 
homogeneous linear differential equation 


L(y) = ar(t)y” + ai(t)y’ + ao(t)y = 0 (1) 


The main result, Theorem 2 given below, shows that we will in principle be able 
to find two linearly independent functions y; and y2 such that all solutions to (1) 
are of the form c;y; + C22, for some constants c; and cz. This is just like the 
second order constant coefficient case. In fact, if g(s) is a characteristic polynomial 
of degree 2, then B, = {y1, y2} is a set of two linearly independent functions 
that span the solution set of the corresponding homogeneous constant coefficient 
differential equation. In Sect. 3.2, we introduced the concept of linear independence 
for a set of n functions. Let us recall this important concept in the case n = 2. 


Linear Independence 


Two functions y; and yz defined on some interval J are said to be linearly 
independent if the equation 
ciyi + coy2 = 0 (2) 


implies that c; and cz are both 0. Otherwise, we call y; and yz linearly dependent. 


Example 1. Show that the functions 


cost sint 
y(t) = “Fz and y(t) = er 
defined on the interval (0, oo) are linearly independent. 


> Solution. The equation c, + cy Sint = 0 on (0, 00) implies c, cost + c2 sint 
= 0. Evaluating att = > andt = z gives 


c2= 0 
-—C(y = 0. 
It follows that y, and y2 are independent. < 


In Sect. 3.2, we provided several other examples that we encourage the student 
to reconsider by way of review. 
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Theorem 2. Let L = a(t)D* +.a,(t)D +.ao(t), where ao(t), a, (t), and a(t) are 
continuous functions on an interval I. Assume az(t) # 0 forallt € I. 


1. There are two linearly independent solutions to Ly = 0. 
2. If yi and yz are any two linearly independent solutions to Ly = 0, then any 
homogeneous solution y can be written y = cy y, + C2y2, for some c1,C2 € R. 


Proof. Letty € I. By Theorem 6 of Sect. 5.1, there are functions, yy; and Wz, that are 
solutions to the initial value problems L(y) = 0, with initial conditions y(fo) = 1, 
y'(to) = 0, and y(t) = 0, y’(to) = 1, respectively. Suppose ci + coW2 = 0. 
Then 

C1 Wi (to) + c2Wo2(to) = 0. 


Since W(t) = 1 and Wo(to) = 0, it follows that c; = 0. Similarly, we have 


ciW} (to) + cov; (to) = 0. 


Since yj (to) = 0 and w5(to) = 1, it follows that c. = 0. Therefore, y and w2 are 
linearly independent. This proves (1). 

Suppose y is a homogeneous solution. Let r = y(t) ands = y’'(to). By 
Theorem 3 of Sect.5.1, the function rw; + sw is a solution to Ly = 0. 
Furthermore, 


rWi(to) + s¥2(to) =r 
and rwi(to) + swW5(to) = s. 
This means the rw; + sy and y satisfy the same initial conditions. By the 
uniqueness part of Theorem 6 of Sect.5.1, they are equal. Thus, y = ry + sy, 
that is, every homogeneous solution is a linear combination of yw and W. 


Now suppose yj and y2 are any two linearly independent homogeneous solutions 
and suppose y is any other solution. From the argument above, we can write 


yi = ay + by, 
y2 = cp + dy, 


which in matrix form can be written 
| Vi | a b | Wi 
y2 ca W 2 


We multiply both sides of this matrix equation by the adjoint [ d =| to obtain 


—¢ @ 
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d—b|[yi] _ [ad —be Oy} yi} _ _ Vi 
P| lamers |e, 


Suppose ad — bc = 0. Then 


dy, = by = 0 
and —cy; +ay2 = 0. 
But since y, and y2 are independent, this implies that a, b,c, and d are zero, which 


in turn implies that y; and y2 are both zero. But this cannot be. We conclude that 
ad — bc # 0. We can now write y, and yf. each as a linear combination of y; and 


y2. Specifically, 
Wi = 1 d —b Yi 
Wr ad—be|—c a]}|y2|° 


Since y is a linear combination of y; and Wo, it follows that y is a linear combination 
of y; and yp. Oo 


Remark 3. The matrix [2 P| that appears in the proof above appears in other 
contexts as well. If y; and y2 are functions, recall from Sect.3.2 that we defined 


the Wronskian matrix by 


_ Pyi(t) y2(t) 
W(y1, Yo)(t) = Eee 20) 


and the Wronskian by 


w(y1, y2)(t) = det W(y1, y2) (0). 


If y; and y> are as in the proof above, then the relations 


yi =a + br, 
y2 = cw td, 


in the proof, when evaluated at fo imply that 


ac yilto) y2(to) 
it Bes tl oe 
Since it was shown that ad — bc # 0, we have w(y1, y2) # 0. On the other hand, 
given any two differentiable functions, y; and yz (not necessarily homogeneous 
solutions of a linear differential equation), whose Wronskian is a nonzero function, 
then it is easy to see that y; and y2 are independent. For suppose fp is chosen so that 
w(¥1, 2)(to) A O and c1y1) + coy2 = 0. Then cy y; + cys = 0, and we have 
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fl = pane aa en 


cl 
= W(1, : 
0 C1; (to) + C25 (to) (1, 92) f| 


Simple matrix algebra? gives c} = 0 and cy) = 0. Hence, y; and y> are linearly 
independent. 


We have thus shown the following proposition. 


Proposition 4. Suppose L satisfies the conditions of Theorem 2. Suppose y, and 
y2 are solutions to Ly = 0. Then y, and y are linearly independent if and only if 


w(1, 2) # 9. 


The following theorem extends Abel’s theorem given in Theorem 8 of Sect. 3.3. 
You are asked to prove this in the exercises. 


Theorem 5 (Abel’s Formula). Suppose f; and fo are solutions to the second 
order linear differential equation 


y" +ar(t)y’ + ao(t)y = 0, 


where ao and a, are continuous functions on an interval I. Let ty € I. Then 


w(fi, P(t) = Ken foe 


for some constant K. Furthermore, if initial conditions y(to) and y’(to) are given, 
then 


K =w(fi, fo)(to). 


Remark 6. Let us now summarize what Theorems 3, 6 of Sect.5.1, and 2 tell us. 
In order to solve L(y) = f/f (satisfying the continuity hypotheses), we first need to 
find a particular solution y,, which exists by the existence and uniqueness theorem. 
Next, Theorem 2 says that if y; and y2 are any two linearly independent solutions 
of the associated homogeneous equation L(y) = 0, then all of the solutions of 
the associated homogeneous equation are of the form c; yj + c2y2. Theorem 3 of 
Sect. 5.1 now tells us that the general solution to L(y) = f is of the form 


{yp tein + C2y2 1 C1, C2 eR}. 


Furthermore, any set of initial conditions uniquely determines the constants c, 
and ¢>. 


*cf. Chapter 8 for a discussion of matrices. 
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A set {y1, y2} of linearly independent solutions to the homogeneous equation 
L(y) = 0 is called a fundamental set for the second order linear differential 
operator L. A fundamental set is a basis of the linear space of homogeneous 
solutions (cf. Sect. 3.2 for the definition of a basis). Furthermore, the standard basis, 
B,, in the context of constant coefficient differential equations, is a fundamental set. 

In the following sections, we will develop methods, under suitable assumptions, 
for finding a fundamental set for Z and a particular solution to the differential 
equation L(y) = ff. For now, let us illustrate the main theorems with a couple 
of examples. 


Example 7. Consider the differential equation 


ty” +ty’+y=0. 


Suppose y(t) = cos(Inf) and y2(t) = sin(Inf) are solutions. Determine the solu- 
tion set. 


> Solution. We begin by computing the Wronskian of {cos In?, sin nf}: 


cosInt sinInt 


w(cos Int, sinInt) = det sinInt cos Int 


t t 


cos? Int + sin? Int 
t 


1 


x 
Proposition 4 implies that {cos(In¢), sin(In¢)} is linearly independent on (0, oo) 
and thus a fundamental set for L(y) = 0. Theorem 2 now implies that 


{c, cos(Int) + cz sin(Int) : cy, cz € R} 


is the solution set. < 


Example 8. Consider the differential equation 
ty” +2y’ +ty =2cost. 


Determine the solution set. 


> Solution. By Example | of Sect. 5.1, a particular solution is yp = sint, and y; = 


cost _ sint : 
<~ and y2 = = are homogeneous solutions. By Example 1, the homogeneous 
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solutions y; and y2 are linearly independent. By Theorem 2, all homogeneous 
solutions are of the form 


cost sin t 
Yh = C11 + C2y2 = ra =F C2——. 


It follows from linearity, Theorem 3 of Sect. 5.1, that the solution set is 


. cost sin t 
¥Y=J)pt+ Yh =sint ie hero Sara eR. 
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Exercises 


1-6. Determine if each of the following pairs of functions are linearly independent 
or linearly dependent. 


NnBWN Re 


- yilt) = 2t, yo(t) = St 

- yilt) =2',  yo(t) = 5! 

. y(t) = Int, yo(t) = ¢ Int on the interval (0, co) 

: yi(t) = etl. y2(t) = e2!-3 

. y(t) = In(2t), ~yo(t) = In(5r) on the interval (0, 00) 
. y(t) =Int?,  yo(t) = Int? 


7-9. For each exercise below, verify that the functions f; and / satisfy the given 
differential equation. Verify Abel’s formula as given in Theorem 5 of Sect. 5.2 for 
the given initial point #). Determine the solution set. 


7. 
8. 
9. 
10. 


11. 


(¢-Dy"-ty +y=0, fi =e -t, Alt) =t, =0 

(1+ t?)y” —2ty’+2y =0, Ai() =1-27, f(t) =t,t =1 

t?y" + ty’ + 4y =0, fi(t) = cos(2Inz), fo(t) = sin(2Inz), t) = 1 

Prove Abel’s formula as stated in Theorem 5. Hint, carefully look at the proof 
of Abel’s formula given in the second order constant coefficient case (cf. 
Theorem 8 of Sect. 3.3). 


1. Verify that y;(t) = # and y(t) = |f?| are linearly independent on 
(—co, oo). 

2. Show that the Wronskian, w(y;, y2)(t) = 0, for allt € R. 

3. Explain why Parts (a) and (b) do not contradict Proposition 4. 

4. Verify that y,(¢) and y(t) are solutions to the linear differential equation 
t?y” —2ty’ =0, y(0)=0, y’(0)=0. 

5. Explain why Parts (a), (b), and (d) do not contradict the existence and 
uniqueness theorem, Theorem 6 of Sect. 5.1. 


348 5 Second Order Linear Differential Equations 


5.3 The Cauchy—Euler Equations 349 
5.3. The Cauchy—Euler Equations 


When the coefficient functions of a second order linear differential equation are 
nonconstant, the corresponding equation can become very difficult to solve. In 
order to expect to find solutions, one must put certain restrictions on the coefficient 
functions. A class of nonconstant coefficient linear differential equations, known as 
Cauchy—Euler equations, have solutions that are easy to obtain. 

A Cauchy-Euler equation is a second order linear differential equation of the 


following form: 


at?y” + bty’ + cy =0, (1) 


where a,b, and c are real constants and a # 0. When put in standard form, we 
obtain 


b Cc 
" / 
+ —y'+—y =0. 
y ae” ape 


The functions é and — are continuous everywhere except at 0. Thus, the existence 
and uniqueness theorem guarantees that solutions exist in either of the intervals 
(—oo, 0) or (0, 00). To work in a specific interval, we will assume t > 0. We will 
refer to L = at?D* + btD + c as a Cauchy-Euler operator. 

The Laplace transform method does not work in any simple fashion here. 
However, the simple change in variable ¢ = e* will transform equation (1) into 
a constant coefficient linear differential equation. To see this, let Y(x) = y(e*). 
Then the chain rule gives 

Y'(x) = ey") 
and ¥"(x) =e*y'(e) +e y"e") 
= (x) + (e*)y"(e*). 


Thus, 


a(e*)’y"(e*) = a¥" (x) —aY'(x) 
be* y'(e*) = bY'(x) 
cy(e*) = cY(x). 


Addition of these terms gives 


a(e*)y"(e*) + be* y'(e*) + cy(e*) = aY" (x) — aY'(x) + bY'(x) + cY¥(x) 
= aY"(x)+ (b—a)Y'(x) + cY(x). 


With ¢ replaced by e* in (1), we now obtain 


aY"(x) + (b—a)Y'(x) + cY(x) = 0. (2) 
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The polynomial 
QO(s) = as? + (b—a)s +e 


is the characteristic polynomial of (2) and known as the indicial polynomial of (1). 
Equation (2) is a second order constant coefficient differential equation and by now 
routine to solve. Its solutions depend on the way Q(s) factors. We consider the three 
possibilities. 


Q Has Distinct Real Roots 


Suppose 7; and rz are distinct roots to the indicial polynomial Q(s). Then e”'* and 
e’?* are solutions to (2). Solutions to (1) are obtained by the substitution x = Int: 
we have e”!* = e”!? — 7"! and similarly e’* = t’. Since t” is not a multiple 
of t’”?, they are independent, and hence, 


{r", 17} 


is a fundamental set for L(y) = 0. 


Example 1. Find a fundamental set and general solution for the equation 17 y” — 


2y = 0. 

> Solution. The indicial polynomial is Q(s) = s? —s —2 = (s — 2)(s + 1) and it 
has 2 and —1 as roots, and thus, { t?, tty is a fundamental set for this Cauchy—Euler 
equation. The general solution is y = cyt? + cot7!. < 


Q Has a Double Root 


Suppose r is a double root of Q. Then e’* and xe”* are independent solutions to 
(2). The substitution x = Int then gives t’ and t” Inf as independent solutions to 
(1). Hence, 

{t’,t’ Int} 


is a fundamental set for L(y) = 0. 

Example 2. Find a fundamental set and the general solution for the equation 
4t?y" + 8ty’+y =0. 

> Solution. The indicial polynomial is O(s) = 457 + 4s + 1 = (2s + 1)? and 


5 as a root with multiplicity 2. Thus, {t72, t-2In t} is a fundamental set. The 


general solution is y = cyt? + Cot? Int. < 


has — 
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Q Has Conjugate Complex Roots 


Suppose Q has complex roots a +if, where B 4 0. Then e®* cos Bx and e®* sin Bx 
are independent solutions to (2). The substitution x = Int then gives 


{t® cos(B Int), t% sin(B Int)} 


as a fundamental set for Ly = 0. 


Example 3. Find a fundamental set and the general solution for the equation ¢7 y” + 
ty’ +y =0. 


> Solution. The indicial polynomial is O(s) = s? + 1 which has +i as complex 
roots. Theorem 4 implies that {cos Inf, sinIn¢} is a fundamental set. The general 
solution is y = c,; cosInt + co sinInt. < 


We now summarize the above results into one theorem. 


Theorem 4. Let L = at?D*? + btD +c, where a,b,c € Randa # 0. Let 
O(s) = as* + (b—a)s + ¢ be the indicial polynomial. 


1. If ry and rz are distinct real roots of O(s), then 
i ee 


is a fundamental set for L(y) = 0. 
2. If r is a double root of Q(s), then 


{t’, t” Int} 


is a fundamental set for L(y) = 0. 
3. Ifa iB are complex conjugate roots of O(s), B 4 0, then 


{t® sin(B Int), t* cos(B Int)} 


is a fundamental set for L(y) = 0. 
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Exercises 


1-11. Find the general solution of each of the following homogeneous 
Cauchy—Euler equations on the interval (0, oo). 
1. t?y"” + 2ty’-2y =0 
2. 2t?y" — Sty’ + 3y =0 
3. 9t7y” + 3ty’+ y =0 
4, t?y” + ty’-2y =0 
5. 4t?y"+y =0 
6. t?y” — 3ty’—-2ly =0 
7. ty" + 7ty’+9y =0 
8. ?y”+y=0 
9. t2 y’ +ty’—4y =0 
10. t?y” +ty’+4y =0 
11. t?y” —3ty’ + 13y =0 
12-15. Solve each of the following initial value problems. 
12. t?y” + 2ty’-2y =0, 
vel a) ae ee) 
13. 427y” + y =0, 
yl) =2, y'(1) =0 
14. t?y” + ty’ + 4y =0, 
y(1) = -3, yl) = 4 
15. t?y” —4ty’ + 6y = 0, 
yO) = 1. yO) == 
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5.4 Laplace Transform Methods 


In this section, we will develop some further properties of the Laplace transform and 
use them to solve some linear differential equations with nonconstant coefficient 
functions. However, we will see that the use of the Laplace transform is limited. 
Several new Laplace transform rules and formulas are developed in this section. For 
quick reference Tables 5.1 and 5.2 in Sect. 5.7 summarize these results. 

Let us begin by recalling an important definition we saw in Sect.2.2. A 
continuous function f on [0,00) is said to be of exponential type with order a 
if there is a constant K such that 


[f@| < Ke® 
for all t € [0, co). If the order is not important to the discussion, we will just say f 


is of exponential type. A function of exponential type has limited growth; it cannot 
grow faster than a multiple of an exponential function. The above inequality means 


—Ke" < f(t) < Ke", 
for all t € [0, 00) as illustrated in Fig. 5.1, where the boldfaced curve, f(t), lies 
between the upper and lower exponential functions. If f is of exponential type, 


then Proposition 3 of Sect. 2.2 tells us that F(s) = £L{f}(s) exists and 


lim F(s) = 0. 
s—*0o 


Fig. 5.1 The exponential function Ke“ bounds f(t) 
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An interesting property of the Laplace transform is that certain limiting values of 
F(t) can be deduced from its Laplace transform and vice versa. 


Theorem 1 (Initial Value Theorem). Suppose f and its derivative f' are of 
exponential order. Let F(s) = L{ f(t)}(s). Then 


Initial Value Principle 


fO)= Jim | sF(s). 


Proof. Let H(s) = L{ f'(t)}(s). By Proposition 3 of Sect. 2.2, we have 
0 = Jim H(s) = lim (6F(s) ~ () = Jim (sF(s) — f(O)). 


This implies the result. Oo 
Example 2. Verify the initial value theorem for f(t) = cosat. 
> Solution. On the one hand, cos at|;29 = 1. On the other hand, 
2 
sL{cosat}(s) = ae 
which has limit 1 as s — oo. < 


Theorem 3 (Final Value Theorem). Suppose f and f' are of exponential type 
and lim;-+o0 f(t) exists. If F(s) = Lif (t)}(s), then 


Final Value Principle 


lim f(t) = lim sF(s). 
too s—>0 


Proof. Let H(s) = L{f'(t)}(s) = sF(s) — f(0). Then sF(s) = H(s) + f(0) and 


lim s¥(s) = lim H(s) + f(0) 
M 


= lim lim e ' f(t) dt + f(0) 


s>0M>o Jo 


M-—>oo 


M 
lim | f'(dt + f) 
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= jim | f(M) — £O) + £0) 


iim, 700) 


II 


The interchange of the limit operations in line 2 above can be justified for functions 
of exponential type. Oo 


Integration in Transform Space 


The transform derivative principle, Theorem 20 of Sect. 2.2, tells us that multipli- 
cation of an input function by —?r induces differentiation of the Laplace transform. 
One might expect then that division by —f will induce integration in the transform 
space. This idea is valid but we must be careful about assumptions. First, if f(t) 
has a Laplace transform, it is not necessarily the case that f(t)/t will likewise. For 
example, the constant function f(t) = 1 has Laplace transform 1 but fo a 4 does 
not have a Laplace transform. Second, integration produces an arbitrary constant of 
integration. What is this constant? The precise statement is as follows: 


Theorem 4 (Integration in Transform Space). Suppose f is of exponential type 
with order a and fo has a continuous extension to 0, that is, lim,_,9+ a exists. 


Then £0 is of exponential type with order a and 


Transform Integral Principle 


Zz {fo} (s) = [°° F(o) do, 


where Ss > a. 


Proof. Let L = lim,_,9+ 4© and define 


JO if t>0 


t 


h(t) = . 
L if +=0 


Since f is continuous, so is h. Since f is of exponential type with order a, there is 
a K so that | f(t)| < Ke’. Since 1 < 1 on [1, 00), 


|A(t)| = 


| sito s Ker, 


for all t > 1. Since h is continuous on [0, 1], it is bounded by B, say. Thus, |A(t)| < 
B < Be“ for allt € [0, 1]. If M is the larger of K and B, then 
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|h(t)| < Me™, 


for all t € [0, 00), and hence h is of exponential type. Let H(s) = L{h(t)}(s) and 
F(s) = L{f(t)} (s). Then, since —th(t) = —f(t), we have, by Theorem 20 of 
Sect. 2.2, H'(s) = —F(s). Thus H is an antiderivative of —F, and we have 


Hi) =— f Foydo +e. 


a 


Proposition 3 of Sect. 2.2 implies 0 = lim, H(s) = — i F(o)do + C, and 
hence, C = oe F(o) do. Therefore, 


(s) = H(s) 


t 


c\ 


= [Fears [Foye 


a 


= | Foye. o 


AY 


The Laplace transform of several new functions can now be deduced from this 
theorem. Consider an example. 


Example 5. Find £ {2+}. 


sint 
13 


sin t ra | 
ia = er: 
fe lo=[ ape 


> Solution. Since lim,_,o = |, Theorem 4 applies to give 


= tan «|? 

= -1 

= ——tan ‘(s) 
1 

= tan! - 


where 9 = tan7!s. < 
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Solving Linear Differential Equations 


We now consider by example how one can use the Laplace transform method to 
solve some differential equations. 


Example 6. Find a solution of exponential type that solves 
ty’ -(_+t)y’+y =0. 


> Solution. Note that the existence and uniqueness theorem implies that solutions 
exist on intervals that do not contain 0. We presume that such a solution has a 
continuous extension to tf = 0 and is of exponential type. Let y be such a solution. 
Let y(0) = yo, y'(O) = yi, and Y(s) = L{y(t)}(s). Application of transform 
derivative principle, Theorem 20 of Sect. 2.2, to each component of the differential 
equation gives 

£{ty”} = -(s*¥(s) — sy) — y'))’ 
—(2sY(s) +. s?¥'(s) — y(0)) 
ji an ey Os te 8 
—sY(s) + yo + (S¥(s) — yo)’ 
sY'(s)—(s —1)¥(s) + yo 
Livy} = Y(s). 


L{-+oy)} 


II 


The sum of the left-hand terms is given to be 0. Thus, adding the right-hand terms 
and simplifying give 


(s —s”)¥’(s) + (—3s + 2)Y¥(s) + 2y0 = 0, 
which can be rewritten in the following way: 


, 3s —2 ed 2Vo 
Y (s) + Gan = (5 — 1’ 


3s—2 _ 
s(s—l) 


2 + a it is easy to see that an integrating factor is J = s?(s — 1), and hence, 


This equation is a first order linear differential equation in Y(s). Since 


(IY(s))' = 2yos. 
Integrating and solving for Y give 


Cc 
¥()= + 
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The inverse Laplace transform is y(t) = yoe’ + c(e’ — t — 1). For simplicity, we 
can write this solution in the form 


y(t) =cye’ +eo(t +1), 


where c; = yo +c and cz = —c. It is easy to verify that e’ and ¢ + 1 are linearly 
independent and solutions to the given differential equation. < 


Example 7. Find a solution of exponential type that solves 
ty” +2y’+ty =0. 


> Solution. Again, assume y is a solution of exponential type. Let Y(s) = 
L{y(t)}(s). As in the preceding example, we apply the Laplace transform and 
simplify. The result is a simple linear differential equation: 


—Yo 


Y'(s)= : 
(s) sz] 


where yo is the initial condition y(0)= yo. Integration gives Y(s)=yo(— tan! s+C). 
By Proposition 3 of Sect. 2.2, we have 0 = lim, +0 Y(s) = yo (—% + C) which 
implies C = > and 


1 
Y(s) = yo (= — tan! s) = yotan! —, 
2 Ss 


By Example 5, we get 


sin t 
y(t) = Yo <q 


Theorem 2 of Sect. 5.2 implies that there are two linearly independent solutions. 
The Laplace transform method has found only one, namely, sat In Sect. 5.5, we 
will introduce a technique that will find another independent solution. When applied 
to this example, we will find y(t) = °* is another solution. (cf. Example 2 of 
Sect. 5.5.) It is easy to check that the Laplace transform of = does not exist, 
and thus, the Laplace transform method cannot find it as a solution. Furthermore, 
the constant of integration, C, in this example cannot be arbitrary because of 
Proposition 3 of Sect.2.2. It frequently happens in examples that C must be 
carefully chosen. 

We observe that the presence of the linear factor t in Examples 6 and 7 
produces a differential equation of order 1 which can be solved by techniques 
learned in Chapter 1. Correspondingly, the presence of higher order terms, t”, 
produces differential equations of order n. For example, the Laplace transform 
applied to the differential equation t7y” + 6y = 0 gives, after a short calculation, 
s?¥"(s) + 4sY’(s) + 8Y(s) = 0. The resulting differential equation in Y(s) is still 
second order and no simpler than the original. In fact, both are Cauchy—Euler. Thus, 
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when the coefficient functions are polynomial of order greater than one, the Laplace 
transform method will generally be of little use. For this reason, we will usually limit 
our examples to second order linear differential equations with coefficient functions 
that are linear terms, that is, of the form at + b. Even with this restriction, we still 
will need to solve a first order differential equation in Y(s) and determine its inverse 
Laplace transform; not always easy problems. 


Laguerre Polynomials 


The Laguerre polynomial, £,(t), of order n is the polynomial solution to 
Laguerre’s differential equation 


ty” + (1—f)y’ +ny =0, 


where y(0) = 1 and x is a nonnegative integer. 


Proposition 8. The nth Laguerre polynomial is given by 


= : yk fp” tk 
m= Dik 1) (ie 


and 


—])” 
Lie} (9) = SS? 


Proof. Taking the Laplace transform of Laguerre’s differential equation gives 


(s?—s)¥'(s) + (s-—C+n))Y() =0 


and hence, Y(s) = C cr . By the initial value theorem, 


s(s —1)" 


gett Cc. 


1= y(0) = lim C 
SOO 


Now using the binomial theorem, we get (s — 1)" = )-;_9 (i) (—1)*s"—* and hence 
Y(s) = > peo(—-L* (2) st It now follows by inversion that y(t) = ¢,(t) = 
Whao(-DE GS. a 
It is easy to see that the first five Laguerre polynomials are: 
fo(t) = 1 
£\(t) =1-t 
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2 
fo(t) =1—2t+ > 


3r2— 3 

£3(t) =1-—3t+ —-— 

3(t) + 5 6 
223 —t# 
Ly = Tah 9 = = |, 
a(t) + 3 Baer 


Below are their graphs on the interval [0, 6]. 


Define the following differential operators: 


E. = 2tD? + (2—2t)D —-1, 
E, =tD?+(1-2)D+(t-1), 
E_=tD’+D. 


Theorem 9. We have the following differential relationships among the Laguerre 
polynomials: 

1. Eoly = —(2n + 1)€, 

2. Ex£n = —(n ce en41 

3. El, = —nty-}. 

Proof. 


1. Let A, = tD* + (1 —t)D +n be Laguerre’s differential equation. Then 
from the defining equation of the Laguerre polynomial £,,, we have A,£, = 0. 
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Multiply this equation by 2 and add —(1 + 2n)£, to both sides. This gives 
E.t, = —(2n + 1)£, 

2. A simple observation gives Ey = A, —tD — (1 —t—n). Since A,¢, = 0, it 
is enough to verify that rf) + (1—ft—n)é, = (n + 1)én + 1. This we do in 
transform space. Let L, = L{l,}. 

£ {tll + (1—t — ney} (8) = —(sLn(s) — £,(0))! + (1 =n) La ls) + Lis) 
= —(Ln + sLi,) + d _ n)Ln + E 
—(s—1)Li —nLy 


= ons — (n+ 1)(s —1)—ns) 


(n+1)L {Ln+1} (s). 


II 


II 


3. This equation is proved in a similar manner as above. We leave the details to the 
exercises. < 


For a differential operator A, let A7y = A(Ay), A?y = A(A(Ay)), etc. It is easy 


to verify by induction and the use of Theorem 9 that 


(0 


n! 


E™£, = £p. 


The operator E+ is called a creation operator since successive applications to fo 
creates all the other Laguerre polynomials. In a similar way, it is easy to verify that 


Ene, = 0, 


for all m > n. The operator E_ is called an annihilation operator. 
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Exercises 


1-4. For each of the following functions, show that Theorem 4 applies and use it to 
find its Laplace transform. 


ale 


t 
cos bt — cosat 
2.2. — 


t 
cos bt — cosat 


2 


sin at 
4. 
t 
5-10. Use the Laplace transform to find solutions to each of the following 
differential equations. In some cases, you may find two independent solutions, and 
in other cases, you may only find one solution. It may be useful to have the following 
table for quick reference: 


ty <— —-Y"(s) 

ty’ <> -sY'(s)—Y(s) 

ty” << +) —-s?¥'(s)—2sY(s) + yo 

ty” < + —s3¥’(s)— 3s?¥(s) + 2syo + y1 
y => Tis) 

yy => 5Y¥(8)— Yo 

y" <> 8’ ¥(s)—syo- 1 


_ ty” +(t-Dy'-y =0 
.ty”+(1+oy'+y=0 

. ty” + (2+ 4t)y’ + (44+ 4t)y =0 

. ty” —2y'+ty =0 

9. ty” —4y’ + ty = 0, assume y(0) = 0 
10. ty” + (24+ 2t)y’+(24+4y =0 


OonNDN 


11-16. Use the Laplace transform to find solutions to each of the following 
differential equations. Use the results of Exercises | to 4. 


11. -ty”+(t-2)y’+y =0 

12. —ty” —2y’+ty =0 

13. ty” + (2—5t)y’ + (6t —5)y = 0 
14. ty” + 2y'’+ 9ty’ =0 
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15. ty” +3y"+ty’+y=0 
16. ty’ +(24+1t)y’+y =0 


17-25. Laguerre Polynomials: Each of these problems develops further properties 
of the Laguerre polynomials. 


17. The Laguerre polynomial of order n can be defined in another way: £,(t) = 


ig ft (e‘t"). Show that this definition is consistent with the definition in the 


n!~ dt” 
text. 


18. Verify (3) in Theorem 9: 


E_L, = —nly-| . 


19. The Lie bracket [A, B] of two differential operators A and B is defined by 
[A, B] = AB — BA. 


Show the following: 


® [Fo, E+] => —2E,. 
* [Eo, E_] = 2E-. 
+ [E,, E_]= Eo. 


(s—a)" 
gal * 


20. Show that the Laplace transform of £, (at), a € R, is 
21. Verify that 


n 


ae —ay'* = £,(at). 


k=0 


22. Show that 
t 
i Dish O=tai0: 
0 


23. Verify the following recursion formula: 


1 
Ln4i(t) = n+1 ((2n + 1- tl, (t) ne,—1(t)) . 


24. Show that 
t 
/ Lil(x)em(t — x) dx = Lnan(t) — lntn4i(t). 
0 


25. Show that 


co 


e “L, (x) dx = e* (€n(t) _ £n-1(t)) : 


5.5 Reduction of Order 367 
5.5 Reduction of Order 


It is a remarkable feature of linear differential equations that one nonzero 
homogeneous solution can be used to obtain a second independent solution. Suppose 
L = ap(t)D? + a;(t)D + ao(t) and suppose y(t) is a known nonzero solution. It 
turns out that a second independent solution will take the form 


y(t) = u(t) yi(¢), (1) 


where u(t) is to be determined. By substituting y2 into Ly = 0, we find that u(t) 
must satisfy a second order differential equation, which, by a simple substitution, 
can be reduced to a first order separable differential equation. After u(t) is found, 
(1) gives y(t), a second independent solution. 

The procedure is straightforward. We drop the functional dependence on ¢ to 
make the notation simpler. The product rule gives 


II 


yg = uy, +uy} 


and yy =u" y, + 2u'y, +uy/. 
Substituting these equations into L y2 gives 
Ly2 = aryy + a1y3 + aoy2 
= an(u"y, + 2u'y, +uyy) + ai(u'y +uyy) + aouy 
u" ayy, + u'(2azy, + ai y1) + u(aoy} + ary, + aoy1) 


u"ary, +u' (2ary; +4191). 


II 


In the third line above, the coefficient of u is zero because y; is assumed to be a 
solution to Ly = 0. The equation L yy = 0 implies 


wary, + u' (2ary} + a1y1) = 0, (2) 


another second order differential equation in uv. One obvious solution to (2) is u(t) a 
constant, implying y2 is a multiple of y;. To find another independent solution, we 
use the substitution v = w’ to get 


Vary + vary, + aiyi) = 0, 


a first order separable differential equation in v. This substitution gives this 
procedure its name: The product reduction of order. It is now straightforward to 
solve for v. In fact, separating variables gives 


Vv _ —2y; a, 


v Ji a2 
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From this, we get 


v= Je fales, 
Ji 


Since v = u’, we integrate v to get 
= | —f ai/a 
u= xe ; (3) 


which is independent of the constant solution. Substituting (3) into (1) then gives 
a new solution independent of y;. Admittedly, (3) is difficult to remember and not 
very enlightening. In the exercises, we recommend following the procedure we have 
outlined above. This is what we shall do in the examples to follow. 


Example 1. The function y(t) = e’ is a solution to 
t=)y =o +y=0. 


Use reduction of order to find another independent solution and write down the 
general solution. 


> Solution. Let y2(t) = u(t)e’. Then 
yx(t) = u'(t)e’ + u(t)e’ 
yi (t) = ul (the + 2u'(t)e’ + u(tye’. 
Substitution into the differential equation (t — 1)y” — ty’ + y = 0 gives 
(t — 1)(u" (t)e’ + 2u'(t)e’ + u(t)e’) — t(u'(t)e’ + u(t)e’) + u(t)e’ = 0 


which simplifies to 
(t — 1)u" + (t —2)u’ = 0. 


Let v = w’. Then we get (t — 1)v’ + (t — 2)v = O. Separating variables gives 


vo —(t —2) 1 
= =-l+ 
v t-—1 t—1 


with solution v = e~‘(t — 1). Integration by parts gives u(t) = f v(t) dt = —te™. 
Substitution gives 
yo(t) = u(t)e’ = —tee’ = —1. 


It is easy to verify that this is indeed a solution. Since our equation is homogeneous, 
we know —y2(t) = ¢ is also a solution. Clearly ¢ and e’ are independent. By 
Theorem 2 of Sect. 5.2, the general solution is 


y(t) =cit + oe". < 
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sint 


Example 2. In Example 7 of Sect. 5.4, we showed that y; = “* is a solution to 


ty” +2y’+ty =0. 


Use reduction of order to find a second independent solution and write down the 
general solution. 


> Solution. Let y2(t) = u(t)@. Then 


sin t t cost — sint 
y(t) = Ww O)—— + ult) rs 


yo(t) =u" (t) 


sint tcost — sint —t? sint — 2tcost + 2sint 

—— + 2u'(t) + u(t) , 
t t? 6 

We next substitute yz into ty” + 2y’ + ty = 0 and simplify to get 

u’(t) sint + 2u’(t) cost = 0. 


Let v = w’. Then we get v’(t) sint + 2v(t) cost = 0. Separating variables gives 


Vv —2cost 


v sin t 


with solution 
v(t) = ese?(t). 


Integration gives u(t) = [ v(t) dt = —cot(t), and hence, 


sin t —cost 
ya(t) = ~(cott)— = ——. 


By Theorem 2 of Sect. 5.2, the general solution can be written as 


sin t cost 
cy — + c7 —. 
; t : t 
Compare this result with Examples 4 of Sect.5.1 and 7 of Sect. 5.4. < 


We remark that the constant of integration in the computation of u was chosen 
to be O in both examples. There is no loss in this for if a nonzero constant, c say, 
is chosen, then yz = uy; + cy,. But cy, is already known to be a homogeneous 
solution. We gain nothing by adding a multiple of it in yo. 
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Exercises 


1-16. For each differential equation and the given solution, use reduction of order 
to find a second independent solution and write down the general solution. 


1. t?y” —3ty’+ 4y =0, 


woH=r 
2. t?y” + 2ty’-—2y =0, 
yi(t) =t 
3. 4t?7y”+ y =0, 
yi(t) = vt 
4, t?y" + 2ty’ = 0, 
yitt) = 1 
5. ty” —t(t+2)y’ + (t+ 2)y =0, 
yilt) =t 


6. t?y” —4ty’ + (t? + 6)y =0, 
yi(t) = t* cost 

7. ty" —y' +4 y =0, 
yi(t) = sin¢? 

8. ty” —2(¢ + 1)y’+ 4y = 0, 


yi(t) =e” 

9. y” —2(sec? t) y = 0, 
yi(t) = tant 

10. ty” +(t-l)y’-y = 0, 
yi) =e" 

11. y” — (tant)y’ — (sec? t)y = 0, 
yi(t) = tant 

12. (1+ 2*)y” —2ty’ + 2y =0, 
yi(t) =t 


13. (cos2t + 1)y” —4y = 0, t € (—2/2, 2/2), 
yilt) = pss 

14. t?y” —2ty’ + (t?+2)y =0, 
y(t) = t cost 

15. 1—2)y"+2y=0, -1<t<1, 
y(t) =1-?? 

16. (1—t?)y"” —2ty’+2y=0, -l<t<1, 
yi(t) =t 
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5.6 Variation of Parameters 


Let L be a second order linear differential operator. In this section, we address 
the issue of finding a particular solution to a nonhomogeneous linear differential 
equation L(y) = f, where f is continuous on some interval J. It is a pleasant 
feature of linear differential equations that the homogeneous solutions can be used 
decisively to find a particular solution. The procedure we use is called variation of 
parameters and, as you shall see, is akin to the method of reduction of order. 

Suppose, in particular, that L = D* +a, (t)D + ao(t), that is, we will assume 
that the leading coefficient function is 1, and it is important to remember that this 
assumption is essential for the method we develop below. Suppose {y1, y2} is a 
fundamental set for L(y) = 0. We know then that all solutions of the homogeneous 
equation L(y) = 0 are of the form c; y, + c2y2. To find a particular solution yp to 
L(y) = f, the method of variation of parameters makes two assumptions. First, 
the parameters c; and c2 are allowed to vary (hence the name). We thus replace 
the constants c; and cz by functions u(t) and u2(t), and assume that the particular 
solution yp, takes the form 


Yp(t) = ui (yi (1) + u(t) y2(0). (1) 
The second assumption is 
u(y) + w(Oy2(t) = 0. (2) 


What is remarkable is that these two assumptions consistently lead to explicit 
formulas for u;(¢) and u2(t) and hence a formula for yp. 
To simplify notation in the calculations that follow, we will drop the “?’” in 
expressions like u;(t), etc. Before substituting yp into L(y) = f, we first calculate 
/ Ny 
yp and y,: 


/ 


Vp = Ui ty, + uyy2 + wrys 
= my, tuys, 


where we used (2) to simplify. Now for the second derivative 


yp = uy, ty! + uy) + wys. 
We now substitute yp into L(y): 


L(yp) 


II 


yn at ay, + doyp 


UY, + uy, + ugyy + uryy + ai(ury + u2yy) + ado(uiy: + ur2y2) 
= uy, + bys tur(y! + ary; + aoyi) + u(yy + ary + aoy2) 


erg ee: roy 
= UY, 1 Uy. 
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In the second to the last equation, the coefficients of u; and uz are zero because yj, 
and y2 are assumed to be homogeneous solutions. The second assumption, (2), and 
the equation L(yp) = f now lead to the following system: 


ui yi + uyy2 = 0 
uy, + uy = f 


which can be rewritten in matrix form as 


I-04 : 
E yJlLel Lf 
The leftmost matrix in (3) is none other than the Wronskian matrix, W(y1, y2), 


which has a nonzero determinant because {y1, y2} is a fundamental set (cf. 
Proposition 4 of Sect. 5.2). By Cramer’s rule, we can solve for uw, and wu’. We obtain 


—_ —yof 

uy = ——_.,, 
w(y1, Y2) 

, vif 

uy => —. 
w(y1, 2) 


We now obtain an explicit formula for a particular solution: 


Yp(t) = uiyi + U2yo 


7 il vif 
7 (/ a5) a ( as) ia 


The following theorem consolidates these results with Theorem 6 of Sect. 5.1. 


Theorem 1. Let L = D* +.a;(t)D + ao(t), where a,(t) and ao(t) are continuous 
on an interval I. Suppose {y\, y2} is a fundamental set of solutions for L(y) = 0. 
If f is continuous on I, then a particular solution, yp, to L(y) = f is given by the 


formula 
_ =Vay vif ) 
— (/ oa) ae (/ w(t ya)?” a 


Furthermore, the solution set to L(y) = f becomes 
{yp teiyi + coy2 2 c1,c2 ER}. 


Remark 2. Equation (4), which gives an explicit formula for a particular solution, 
is too complicated to memorize, and we do not recommend students to do this. 
Rather, the point of variation of parameters is the method that leads to (4), and our 
recommended starting point is (3). You will see such matrix equations as we proceed 
in the text. 
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We will illustrate the method of variation of parameters with two examples. 


Example 3. Find the general solution to the following equation: 
ty” —2y =t7 Int. 
> Solution. In standard form, this becomes 


2 
_ ave Int. 


The associated homogeneous equation is y” — (2/t*)y = 0 or, equivalently, 17 y” — 
2y = 0 and is a Cauchy—Euler equation. The indicial polynomial is Q(s) = s? — 
s—2 = (s—2)(s+1), which has 2 and —1 as roots. Thus, {r-! : 4 is a fundamental 
set to the homogeneous equation y” — (2/t7)y = 0, by Theorem 4 of Sect. 5.3. Let 
Yp = t!ui(t) + t7un(t). Our starting point for determining wu; and up is the matrix 
equation 


which is equivalent to the system 


re, + ul, = 0 
—t7u + 2tu, = Int. 


Multiplying the bottom equation by ¢ and then adding the equations together give 


Bt, = t Int, and hence, 
1 
u, = — Int. 
3t 
Substituting w/, into the first equation and solving for u/, give 
12 
u, = —— Int. 
3 


Integration by parts leads to 
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We substitute uw; and uw into (1) to get 


Oa es” | eS ons cin 
=-— —infg- — >Un = Sa n _ n : 
oe 3 9 6 54 
It follows that the solution set is 
12 
}5q(O(ing)?— bint +2)4 or! beat? sc1.c2 ER . - 
Example 4. Find the general solution to 
ty” + 2y'+ty =1. 


Use the results of Example 2 of Sect. 5.5. 


> Solution. Example 2 of Sect. 5.5 showed that 


sin t cost 


yi(t) = —— and y2(t) = <= 


are homogeneous solutions to ty” + 2y’+ty = 0. Let yp = nt y(t) + SS yo(t). 
Then 


sin t cost 


a el =) 


t t eA = 
tcost —sint —fsint —cost us(t) 
i - 


(We get 1/t in the last matrix because the differential equation in standard form is 
y” + (2/t)y’ + y = 1/t.) From the matrix equation, we get the following system: 


sin ¢ cost 
——ui (t) + uy(t) = 0, 
t t 
t cost — sint —t sint — cost 1 
aD) + aD) = a 


The first equation gives 
u(t) = —(cott)u5(t). 
If we multiply the first equation by t, the second equation by ¢”, and then add, we get 


(cost)u'(t) — (sint)u5(t) = 1. 


Substituting in u(t) and solving for u5(t) give u(t) = —sint, and thus, u(t) = 
cost. Integration gives 
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u,(t) = sint, 
uy(t) = cost. 

We now substitute these functions into y, to get 


sin ¢ cost 
ss sint + i. cost 


II 


Yp(t) 


sin? t + cos? t 
t 


The general solution is 
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Exercises 


1-5. Use variation of parameters to find a particular solution and then write down 
the general solution. Next solve each using the method of undetermined coefficients 
or the incomplete partial fraction method. 


1. 


y’ +y =sint 
yy at 4y —_ e2! 

. y”-2y'+5y =e 
y” 4 3y’ = et 

. yl" — 3y’ +2y = et 


6-16. Use variation of parameters to find a particular solution and then write down 
the general solution. In some exercises, a fundamental set {y,, y2} is given. 


6. 


y" dy! by = 
.y’+y=sect 


. t?y” — ty’ +2y = t4 
. ty” —y' = 317-1 


y” +y = tant 


t 


yi(t) = Land y2(t) = ¢? 


. ty” ty’ +y =e 
yl dy! +49 = ay 
. y” —(tant)y’ — (sec? t)y = t 


yi(t) = tant and y(t) = sect 


.ty’+(t-ly'-y=t?e* 


y(t) =t—1and y(t) =e“ 


: ty” —y’ A Atty = 4pt> 


y, = cost? and y2(t) = sint? 


” —, 
-Y TY = Ther 


. Show that the constants of integration in the formula for y, in Theorem | can 


be chosen so that a particular solution can be written in the form: 


Bee | 
— fi lLyi@® — y2@) 
‘ no f [2 ral 


yx) y5(x) 


Ff (x)dx, 


where a and ¢ are in the interval J, and the absolute value signs indicate the 
determinant. 


18-21. For each problem below, use the result of Problem 17, with a = 0, to obtain 
a particular solution to the given differential equation in the form given. Solve the 
differential equation using the Laplace transform method and compare. 
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18. y’ +a’y= f(t) 

19. y”—a’y = f(t) 

20. y” —2ay’ +a’y = f(t) 

21. y"—(a+b)y'+aby = f(t), a#b 


5.7 Summary of Laplace Transforms 381 
5.7. Summary of Laplace Transforms 


Laplace transforms and rules presented in Chap. 5 are summarized in Tables 5.1 and 
ses 


Table 5.1 Laplace transform rules 


Assumptions Result Page 
Initial value theorem 
1. J. f’ of exponential order fO) = jim, sF(s) 356 
Final value theorem 
2: Ff, f’ of exponential order and lim f(t) = lim sF(s) 356 
too s>0 


lim;+o0 f(t) exists 
Transform integral formula 
3. f of exponential order and L {a} (s) = i F(a) do 357 


fo has a continuous extension to 0 


Table 5.2 Laplace transforms 


F(t) F(s) Page 
sint _,1 
1. — tan” * — 358 
t 5 
sinat a 
-1(4 
2. tan (<) 365 
et — eat s—a 
, — 1 
3 n (: = “) 365 
" 3008 bt —cosat \ er+a2 365 
. ———__— n{ ———— 
t gs? + b2 
cos bt — cos at gs? + hb? _, [% 
5. 2—_—__——_ sin — 2btan = 365 
t? s? + a? Ss 


+2a tan! (<) 


Laguerre polynomials 


4 sc 1 n 
6. f(t) = Vyao(- OE o 


gil 
(s— a)" 


gt +1 


361 


7: l,(at) 


366 


Chapter 6 
Discontinuous Functions and the Laplace 
Transform 


Our focus in this chapter is a study of first and second order linear constant 
coefficient differential equations 


y' +ay = fo), 
y” +ay' + by = f(), 


where the input or forcing function f(t) is more general than we have studied so far. 
These types of forcing functions arise in applications only slightly more complicated 
than those we have already considered. For example, imagine a mixing problem (see 
Example 11 of Sect. 1.4 and the discussion that followed it for a review of mixing 
problems) where there are two sources of incoming salt solutions with different 
concentrations as illustrated in the following diagram. 


Salt Mixturel Salt Mixture2 


| 


Initially, the first source may be flowing for several minutes. Then the second source 
is turned on at the same time the first source is turned off. Such a situation will result 
in a differential equation y’ + ay = f(t) where the input function has a graph 
similar to the one illustrated in Fig. 6.1. The most immediate observation is that the 
input function is discontinuous. Nevertheless, the Laplace transform methods we 
will develop will easily handle this situation, leading to a formula for the amount of 
the salt in the tank as a function of time. 

As a second example, imagine that a sudden force is applied to a spring-mass 
dashpot system (see Sect. 3.6 for a discussion of these systems). For example, hit 
the mass attached to the spring with a hammer, which is a very good idealization of 
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Fig. 6.1 The graph of 
discontinuous input function 
F(t) where salt of 
concentration level | enters 
until time t = 2, at which 
time the concentration 
switches to a different level 


Concentration | 


Concentration 2 


1 1 1 is ¢ 


0 1 2 3 4 


what happens to the shock absorber on a car when the car hits a bump in the road. 
Modeling this system will lead to a differential equation of the form 


y" +ay’ + by = f(t), 


where the forcing function is what we will refer to as an instantaneous impulse 
function. Such a function has a “very large” (or even infinite) value at a single instant 
t = fo and is O for other times. Such a function is not a true function, but its effect on 
systems can be analyzed effectively via the Laplace transform methods developed 
later in this chapter. 

This chapter will develop the necessary background on the types of discontinuous 
functions and impulse functions which arise in basic applications of differential 
equations. We will start by describing the basic concepts of calculus for these more 
general classes of functions. 
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6.1 Calculus of Discontinuous Functions 


Piecewise Continuous Functions 


A function f(t) has a jump discontinuity at a point t = a if the left-hand limit 
f(a-) = lim,,- f(t) and the right-hand limit f(a) = lim,_,,+ f(t) both exist 
(as real numbers, not oo) and 


fat) 4 fla). 


The difference f(at)—f(a~) is frequently referred to as the jump in f(t) at 
t=a. Functions with jump discontinuities are typically described by using different 
formulas on different subintervals of the domain. For example, the function f(t) 
defined on the interval [0, 3] by 


3 if 0<t <1, 
fO=41=7 Tilers, 
1 if 2<t<3 


has a jump discontinuity att = 1 since f(1-) = 1 4 f(1*) = Oand att = 2 
since f(2~) = —1 4 f(2*) = 1. The jump at ¢ = 1 is —1 and the jump at ¢ = 2 
is 2. The graph of f(t) is given in Fig. 6.2. On the other hand, the function 


1/d—-t) if0<t<1l, 
g(t) = 
ifl<t <2. 
defined on the interval [0, 2] has a discontinuity at f = 1, but it is not a jump 
discontinuity since lim;_,;- g(t) = oo does not exist. 
We will say that a function f(t) is piecewise continuous on a closed interval 
[a, b] if f(t) is continuous except for possibly finitely many jump discontinuities. 


y 
1.0 * 
0.5 
0 Ll 1> ¢ 
0.5 2.5 3.0 
-0.5 b 
Fig. 6.2 A piecewise 
continuous function -1.0 F 
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For convenience, it will not be required that f(t) be defined at the jump discon- 
tinuities. Suppose a,, ..., a, are the locations of the jump discontinuities in the 
interval [a, b] and assume a; < a;+, for each i. On the interval (a;,a;41), we can 
extend f(t) to a continuous function on the closed interval [a;, a;+,] by defining 
f(a) = lim,_, , : F(t) and f(aj41) = lim;+¢- aa F(t). Since a continuous function 
on aclosed interval is bounded and there are only finitely many jump discontinuities, 
we have the following property of piecewise continuous functions. 


Proposition 1. [f f(t) is a piecewise continuous function on |a, b], then f(t) is 
bounded. 


How do we compute the derivative and integral of a piecewise continuous 
function? 


Integration of Piecewise Continuous Functions 


If f(t) is a piecewise continuous function on the interval [a, b] and the jump 
discontinuities are located at a; <... < ax, we may let a9 = a and ag4, = D, 
and, as we observed above, f(t) extends to a continuous function on the each closed 
interval [a;, a;+1]. Thus, we can define the definite integral of f(t) on [a, b] by the 
formula 


ak+1 


frow=f ross f rows / f(t) dt. 


ak 


Example 2. Find fi f(u) du for all t € [0, co) where f(t) is the piecewise 
continuous function defined by 


1 if 0<t<1l, 


0 if l<t<ow. 


fo=| 


> Solution. The function f(t) is given by different formulas on each of the 
intervals [0, 1) and [1, co). We will therefore break the calculation into two cases. If 
t € [0, 1), then 


t 


a a 


0 


Itt € [1, co), then 
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y= f(t) y= i, f(u)du 


Fig. 6.3 The graph of the piecewise continuous function f(t) and its integral i f(u) du 


j fu) du = / f(u) du+ / f(u) du 


t 


=14 fodu=1. 


1 


Piecing these functions together gives 


f soran=f" if 0<t<1 
0 


1 if l<t<oa@. 


The graph of this function of ¢ is shown in Fig. 6.3. < 


Notice that the function i Ff (u) du is a continuous function of t, even though the 
integrand f(t) is discontinuous. This is always true as long as the function f(t) has 
only jump discontinuities, which is formalized in the following result. 


Proposition 3. [f f(t) is a piecewise continuous function on an interval |a, b] and 
c, t € [a,b], then the integral f Ff (u) du exists and is a continuous function in the 
variable t. 


Proof. The integral exists as discussed above. Let F(t) = . F(u) du. Since f(t) 
is piecewise continuous on [a, b], it is bounded by Proposition 1. We may then 
suppose | f(t)| < B, for some B > 0. Let e > 0. Then 


tte tte 


|F(t +¢) — F(t)| < : If(w)| dus [ Bau = Be. 


b 


Therefore, lim, 59 F(t + ©) = F(t), and hence, F(t*) = F(t). Ina similar way, 
F(t_) = F(t). This establishes the continuity of F. Oo 
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y 
1 
t > t 
-1 1 
-1+ —_____- 
y= ft) y= f(t) 


Fig. 6.4 The graph of the piecewise continuous function f(t) and its derivative f’(t) 


Differentiation of Piecewise Continuous Functions 


In the applications, we will consider functions that are differentiable except at 
finitely many points in any interval [a, b] of finite length. In this case we will use 
the symbol f’(t) to denote the derivative of f(t) even though it may not be defined 
at some points. For example, the absolute value function 


feo =ll=| t if —co<t<0 


t if O<t<o. 


This function is continuous on (—oo, oo) and differentiable at all points except 
t = 0. Then 

-l if -w<t<0 

LO= 

1 if O<t<ow. 
Notice that f’(t) is not defined at t = 0, but the derivative of this discontinuous 
function has produced a function with a jump discontinuity where the derivative 
does not exist. See Fig.6.4. Compare this with Fig. 6.3, where we have seen that 
integrating a function with jump discontinuities produces a continuous function. 


Differential Equations and Piecewise Continuous Functions 


We now look at some examples of solutions to constant coefficient linear differential 
equations with piecewise continuous forcing functions. We start with the first order 
equation y’ + ay = f(t) where a is a constant and f(t) is a piecewise continuous 
function. An equation of this type has a unique solution for each initial condition 
provided the input function is continuous, which is the situation for f(t) on each 
subinterval on which it is continuous. To be able to extend the initial condition in 
a unique manner across each jump discontinuity, we shall define a function y(t) to 
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Fig. 6.5 The graph of the 
solution to Example 4 


be a solution to y' + ay = f(t) if y(t) is continuous and satisfies the differential 
equation except at the jump discontinuities of the of the input function f(t). 


Example 4. Find a solution to 


4 if 0<t<1 
y+2y= fO= oie Es y(0) = 1. (1) 
0 if l<t<ow, 


> Solution. The procedure will be to solve the differential equation separately 
on each of the subintervals where f(t) is continuous and then piece the solution 
together to make a continuous solution. Start with the interval [0 1) which includes 
the initial time tf = 0. On this first subinterval, f(t) = 4, so the differential 
equation to be solved is y’ + 2y = 4. The solution uses the integrating factor 
technique developed in Sect. 1.4. Multiplying both sides of y’ + 2y = 4 by the 
integrating factor, e”’, leads to (e*’y)’ = 4e’. Integrating and solving for y(t) 
gives y(t) = 2+ ce~*’, and the initial condition y(0) = 1 implies that c = —1 so 
that 

2t 


y=2-e", O0<t<l. 


On the interval [1, oo), the differential equation to solve is y’ + 2y = 0, which has 
the general solution y(t) = ke~*. To produce a continuous function, we need to 
choose k so that this solution will match up with the solution found for the interval 
[0, 1). To do this, let y(1) = y(1~) = 2—e7”. This value must match the value 
y(1) = ke~* computed from the formula on [1, 00). Thus, 2— e~? = ke~? and 
solving for k gives k = 2e? — 1. Therefore, the solution on the interval [1, 00) is 
y(t) = (2e* — 1)e~*". Putting the two pieces together gives the solution 


2—e if 0<t<1 
yt) = 


(2e?7-Ne* if 1<t<o. 


The graph of this solution is shown in Fig.6.5, where the discontinuity of the 
derivative of y(t) at t = 1 is evident by the kink at that point. < 
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The method we used here insures that the solution we obtain is continuous and 
the initial condition at f = 0 determines the subsequent initial conditions at the 
points of discontinuity of f. We also note that the initial condition at t = 0, the left- 
hand endpoint of the domain, was chosen only for convenience; we could have taken 
the initial value at any point f9 > O and pieced together a continuous function on 
both sides of to. That this can be done in general is stated in the following theorem. 


Theorem 5. Suppose f(t) is a piecewise continuous function on an interval [a, B] 
and to € [a, B]. There is a unique continuous function y(t) which satisfies the initial 
value problem 


y' +ay= fO, y(to) = yo. 


Proof. Follow the method illustrated in the example above to construct a continuous 
solution. To prove uniqueness, suppose y(t) and y(t) are two continuous solu- 
tions. If y(t) = yi(t) — yo(t), then y(t) = 0 and y(t) is a continuous solution to 
y’+ay = 0. On the interval containing fo on which f(t) is continuous, y(t) = 0 by 
the existence and uniqueness theorem. The initial value at the endpoint of adjacent 
intervals is thus 0. Continuing in this way, we see that y(t) is identically 0 on [a, 8] 
and hence y;(t) = yo(f). oO 


Now consider a second order constant coefficient differential equation with a 
piecewise continuous forcing function. Our method is similar to the one above, 
however, we demand more out of our solution. Since the solution of a second 
order equation with continuous input function is determined by the initial values 
of both y(t) and y’(t), it will be necessary to extend both of these values across the 
jump discontinuity in order to obtain a unique solution with a discontinuous input 
function. Thus, if f(t) is a piecewise continuous function, then we will say that a 
function y(t) is a solution to 


y" + ay’ + by = f(t), 


if y(t) is continuous, has a continuous derivative, and satisfies the differential 
equation except at the discontinuities of the forcing function f(t). 


Example 6. Find a solution y to 


1 if O0<t<az 
y+y=fO= 
0 ifam<t<wow, 


y(0) = 1, y') =0. 

> Solution. The general solution to the differential equation y” + y = 1| on the 
interval [0, 7) is y(t) = 1+ acost + bsint, and the initial conditions y(0) = 1, 
y’(0) = O imply a = 0, b = 0, so the solution on [0, z) is y(t) = 1. Taking limits 
ast — a” gives y(x) = 1, y’(x) = O. On the interval [z, oo), the differential 
equation y” + y = f(t) becomes y” + y = 0 with the initial conditions y(z) = 1, 
y'(xt) = 0. The general solution on this interval is thus y(t) = acost +b sint, and 
taking into account the values att = m givesa = —1, b = 0. Piecing these two 
solutions together gives 
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a b 
y y 
1 1 
0 1 1 1+t QO >t 
wT 20 37 Tv T 37 
-1 -1 


Fig. 6.6 The graph of the solution y(t) to Example 4 is shown in (a), while the derivative y’(t) is 
graphed in (b). Note that the derivative y’(t) is continuous, but it is not differentiable at t = a 


1 if O<t<az 
yO= 
—cost if t<t<o. 
Its derivative is 
0 if O<t<az 
y= 


sint if 7<t<ow. 


Figure 6.6 gives (a) the graph of the solution and (b) the graph of its derivative. 
The solution is differentiable on the interval [0, co], and the derivative is continuous 
on [0, co). However, the kink in the derivative at t = z indicates that the second 
derivative is not continuous. < 


In direct analogy to the first order case we considered above, we are led to the 
following theorem. The proof is omitted. 


Theorem 7. Suppose f is a piecewise continuous function on an interval [a, B| and 
to € [a, B]. There is a unique continuous function y(t) with continuous derivative 
which satisfies 


y" + ay’ + by = f(t), y(to) = yo. y(t.) = V1. 


Piecing together solutions in the way that we described above is at best tedious. 
Later in this chapter, the Laplace transform method for solving differential equations 
will be extended to provide a simpler alternate method for solving differential 
equations like the ones above. It is one of the hallmarks of the Laplace transform. 
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Exercises 


1-8. Match the following functions that are given piecewise with their graphs and 
determine where jump discontinuities occur. 


1 if 0<1r<4 


1 f@)= 4-1 if 4<t<5 
0 if 5<t<6 


t ifO0<t<l 
2. ft)=42-t if l<t<2 

1 if 2<t<6 

t/3 if 0<t <3 


3. = 
fe) hae if 3<t<6 


4. f(t) =t—nforn<t<n+land0<n <5 


1 if 2n<t<2 1 
5. f(t) = eae forO <n <2 
O if 2n+1<t<2n+2 


t? if 0<t <2 
4 if 2<t <3 
7-t if 3<t<6 


5-t if 4<t<6 


1 if 0<t<2 
3-t if 2<t<3 
2¢-—3) if 3<t<4 
2 if 4<t<oo 


l1-t if O0O<t<2 
7. ft)= 33-t if 2<t<4 
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Graphs for problems I through & 


Hu 


c d 


e 


9-12. Compute the indicated integral. 


t?—4 if 0<t<2 
9. Ae f(t) dt, where f(t) = 40 gece are 
—-t+3 if 3<t<5 


2-u if O<u<l 


10. a f(u) du, where f(u) = 4, 


u if l<u<2 
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2m |. 
11. f” |sin x| dx 


w if 0O<w<l 


12. fo. fw) dw where fw) = 4 if l1<w<2 


5 if 2<w<oo 


13-16. Compute the indicated integral (See problems 1-8 for the appropriate 
formula to match with each graph.) 


13. Fe f(t) dt, where the graph of f is 


2 


15. i f (u) du, where the graph of f is 


1 


oi — 1 
0 1 2 3 4 5 6 


16. ri f(t) dt, where the graph of f is 


4 
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17-20. Of the following four piecewise-defined functions, determine which ones 


(a) Satisfy the differential equation 


4 if 0<t<2 
y+4y= f= 
8t if 2<t<o, 


except at the point of discontinuity of f 

(b) Are continuous 

(c) Are continuous solutions to the differential equation with initial condition 
y(0) = 2. Do not solve the differential equation 


1 if O0<t<2 
17. y(t) = 
2t—-5-—3e%™ if 2<t<o@ 
lt+e* ifO<1<2 
18. y(t) = 
2t—1-SeH-D pe if 2<1 <00 
l+e% ifO<t<2 
19. y(t) = 
I 5e74(t—-2) : 
=== et <o 
e-4 if O<t<2 
20. y(t) = 


2t—f—se "+e" if 2<t<co 
21-24. Of the following four piecewise-defined functions, determine which ones 


(a) satisfy the differential equation 


e! if 0<t<l1 
y” —3y' +2y = f(t) = 6 ; 
e if l<t<o, 


except at the point of discontinuity of f 

(b) Are continuous 

(c) Have continuous derivatives 

(d) Are continuous solutions to the differential equation with initial condition 
y(0) = O and y’(0) = O and have continuous derivatives. Do not solve the 
differential equation. 
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—teé-—e+e% if 0O<t<1 
21. y(t) = ‘ ; 

te* — 2e! ifl<t<o 

—te' —e’ + e7 if 0<t<1 
22. y(t) = 


te? —3e' —fe% if 1<t<oo 


—te! — ef 2t : < 
2. 0 =| e'—e'+e if 0<t<1l 


te? + etl ef —e% —e%-! if 1<t<oco 


—te’ + e! — 7! if O<t<1 
24. y@) a 2t t+1 t 2t-1 2t : 
te’ +e" +e —-e —3e if l1<t<o@ 


25-30. Solve the following differential equations. 


1 if0<¢ <2, 
3. y-y=4=1 f2<6 <4, y(0) =0 


0 if4<t<o 


t if 0<t<l 
26. y+ 3y = ee y(0) =0 
1 if l1<t<ow, 
0 if 0<t<l 
t-—1 if l<t<2 
27. y-y= = 0) =0 
+ 3-t if 2<t<3 ¥(0) 
0 if 3<t<o, 
sin t if 0O<t<az 
28. W+y= ; ~ y(x) = —-1 
0 if t<t<o 
t if 0<t<l 
29. yy-yati Pst s y0) =0, y')=1 
0 iif l<t<o, 


0 fdO<t<2 


(0) = 1, y’(0) =0 
4 if 2<t<o ©) 


30. yp" —4y' + 4y = | 


31. Suppose f is a piecewise continuous function on an interval [a, B]. Let a € 
[a, B] and define y(t) = yo fi J(u) du. Show that y is a continuous solution to 


y= ft) y@=yo 
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32. Suppose f is a piecewise continuous function on an interval [a, B]. Let a € 
[a, B] and define y(t) = yo +e { e“ f(u) du. Show that y is a continuous 
solution to 

y'+ay= ft) y@ = yo 
a Lage sin(l/t) if t40 
0 if r=0 


(a) Show that f is bounded. 
(b) Show that f is not continuous at ¢ = 0. 
(c) Show that f is not piecewise continuous. 
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6.2 The Heaviside Class H 


In Chap. 2, the Laplace transform was introduced and extensively studied for the 
class of continuous functions of exponential type. We now want to broaden the range 
of applicability of the Laplace transform method for solving differential equations 
by allowing for some discontinuous forcing functions. Thus, we say a function f(t) 
is piecewise continuous on [0, 00) if f(t) is piecewise continuous on each closed 
subinterval [0, b] for all b > 0. In addition, we will maintain the growth condition 
so that convergence of the integrals defining the Laplace transform is guaranteed. 
Thus, we will define the Heaviside class to be the set H._ of all piecewise continuous 
functions on [0, 00) of exponential type. Specifically, f € H if: 


1. f is piecewise continuous on [0, oo). 
2. There are constants K anda such that | f(t)| < Ke forall t > 0. 


One can show H is a linear space, that is, closed under addition and scalar 
multiplication (see Exercises 43-44). It is to this class H of functions that we extend 
the Laplace transform. The first observation is that the argument of Proposition 3 of 
Sect. 2.2 guaranteeing the existence of the Laplace transform extends immediately 
to functions in H. 


Proposition 1. For f € H of exponential type of order a, the Laplace transform 
F(s) = fo? e™ f(t) dt exists for s > a, and lims oo F(s) = 0. 


Proof. The finite integral N e*' f(t) dt exists because f is piecewise continuous 
on [0, N]. Since f is also of exponential type, there are constants K > 0 anda such 
that | f(t)| < Ke” for all t > 0. Thus, for all s > a, 


s-a 


[o.e) [o,@) CO 
|F(s)| < / le“ f(t)| dt < le" Ke" | dt = aoe dt = 
0 0 0 


This shows that the integral converges absolutely, and hence, the Laplace transform 
exists for s > a and F(s) < K/(s —a). It follows that 


lim F(s) = 0. Oo 
SOO 


Many of the properties of the Laplace transform that were discussed in Chap. 2, and 
collected in Table 2.3, for continuous functions carry over to the Heaviside class 
without change in statement or proof. Some of these properties are summarized 
below. 
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Linearity Liaf +bg}=al{f}+bLli{g}. 
The first translation principle Lie f(t)} (s) =L{f@)} (s — a). 
Differentiation in transform space L(-tf(t)) = <F(s), 


L(t)" f(t)} = F(s). 


The dilation principle L{f(bt)} (s) = se {f()} (s/b). 


The important input derivative formula is not on the above list because of a 
subtlety to be considered in the next section. For now, we will look at some direct 
computations of Laplace transforms of functions in H and a useful tool (the second 
translation theorem) for avoiding most direct calculations. 

As might be expected, computations using the definition to compute Laplace 
transforms of even simple piecewise continuous functions can be tedious. 


Example 2. Use the definition to compute the Laplace transform of 


r=} if O<t <1, 


2, if l<t<o. 


> Solution. Clearly, f is piecewise continuous and bounded; hence, it is in the 
Heaviside class. We can thus proceed with the definition confident, by Proposition 1, 
that the improper integral will converge. We have 


CO 


Lif} (8) = / eft) dt 


CO 
= i t?dt + ee 2dt 
1 


For the first integral, we need integration by parts twice: 


a) 1 
+o fered 
0 S 

0 


aie, 
+ je dt 
0 S 
0 


1 


2a—st 
per Paes 
—s 


0 


e*’ 2] te 


+ 
=S Ss —s 
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Fig. 6.7 The graph of the 


y 
Heaviside function h(t) (also 
called the unit step function) 1 
>t 
—1 
er. of e* 1.) 
= + — _ 5 e 
Ss s Ss Ss 0 
6% 2% 4 2 26% 
—  § s so ¢ 
The second integral is much simpler, and we get 
oe) 5) a 
feo 2dt = —. 
Ss 
1 
Now putting the two pieces together and simplifying gives 
2 = 2 2 1 
cif) = +e" (-5-542). z 


As we saw for the Laplace transform of continuous functions, calculations 
directly from the definition are rarely needed since the Heaviside function that we 
introduce next will lead to a Laplace transform principle that will allow for the 
use of our previously derived formulas and make calculations like the one above 
unnecessary. The unit step function or Heaviside function is defined on the real 
line by 
0 if t <0, 


1 if O<t<o@m. 


h(t) = | 


The graph of this function is given in Fig. 6.7. 

Clearly, h(t) is piecewise continuous, and it is bounded so it is of exponential 
type, and hence, h(t) € H. In addition to h(r) itself, it will be necessary to consider 
the translations h(t — c) of h(t) for all c => 0. From the definition of h(t), we see 


0 if —-wK<t<c, 


1 if c<t<o. 


Meo =| 


Note that the graph of h(t — c) is just the graph of h(t) translated c units to the 
right. The graphs of two examples are given in Fig. 6.8. 
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Fig. 6.9 The graph of the on-off switch 7 {q_4)(¢) 


More complicated functions can be built from the Heaviside function. The most 
important building block is the characteristic function Yjq,y)(t) on the interval 
[a, b) defined by 
1 ift e[a, b), 


eae ae é [a, b). 


The characteristic function Y{q)(t) serves as the model for an on-off switch at 
t = a (on) and t = b (off). That is, xj¢,,)(¢) is 1 (the on state) for ¢ in the interval 
[a, b) and 0 (the off state) for ¢ not in [a, b). Because of this, we shall also refer to 
Xa.b)(t) as an on-off switch. A graph of a typical on-off switch is given in Fig. 6.9. 

Here are some useful relationships between the on-off switches y|,,,)(t) and the 
Heaviside function A(t). All are obtained by direct comparison of the value of the 
function on the left with that on the right. 


1. Xj0,00)(t) = h(t), and if these functions are restricted to the interval [0, co) 
(rather than defined on all of R), then 


Xo. 0) (t) = A(t) = 1. (1) 


2. If0 < a < o, then 
Xa, co) (t) = h(t — a). (2) 


3. f0<a <b < o, then 


Xia,b)(t) = h(t —a) —h(t —). (3) 
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Using on-off switches, we can easily describe functions defined piecewise. The 
strategy is to write f(t) as a sum of terms of the form fi (t)¥{a;.a,4,)(0 if fi 
is the formula used to describe f(t) on the subinterval [a;, a;+1). Then using the 
relationships listed above, it is possible to write f(t) in terms of translates of the 
Heaviside function h(t). Here are some examples. 


Example 3. Write the piecewise-defined function 


e if O<t<1, 
f(t) = 5 


if l<t<o. 


in terms of on—off switches and in terms of translates of the Heaviside function. 
> Solution. In this piecewise function, t? is in the on state only in the interval [0, 1) 


and 2 is in the on state only in the interval [1, co). Thus, 


f(t) = Px.) + 2X11,00)(t). 


Now rewriting the on-off switches in terms of the Heaviside functions using (1)—-(3), 
we obtain 


t?(h(t) — h(t — 1)) + 2h(t — 1) 
= h(t) + (2—t7)h(t — 1) 
=0?+(2-2)A(t —1). < 


ff) 


Example 4. Write the piecewise-defined function 


cost if O0O<t<gZ, 
ft) = 41 if m7 <t <2z, 


0 if 27 <t<o. 


in terms of on—off switches and in terms of translates of the Heaviside function. 


> Solution. The function is defined by different formulas on each of the intervals 
[0, x), [x, 22r), and [27, oo). Thus, 


ft) 


II 


COs t X10, x) (t) - 1X [x, 27) (t) - OX 27, 00) (t) 
cost(h(t) — h(t — )) + (A(t — 2) — h(t — 27) 
(cost)h(t) + (1 —cost)h(t — 2) — h(t — 22) 


II 


II 


II 


cost + (1 —cost)h(t — 2) —h(t — 27). < 
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Fig. 6.10 The graphs of (a) h(t—1) f(t), (b) f(t—1), and (e) h(t—1) f(t—1) for f(t) = 2t—-2? 


In the above descriptions, there are functions of the form g(t)h(t — c) and 
&(t) X{a,b)(t). How do the graphs of these functions correspond to the graph of g(t)? 
Here is an example. 


Example 5. Compare the graph of each of the following functions to the graph of 
f(t) = 2t —-t?: 
@MAC-DIO) OMfE-Il OhC-I)fE-D 


> Solution. The graphs are given in Fig. 6.10. 

The graph of f(t) is given first. Now, (a) h(t — 1) f(t) simply cuts off the graph of 
F(t) at t = 1 and replaces it with the line y = 0 fort < 1, (b) f(t — 1) just shifts 
the graph of f(t) 1 unit to the right, and (c) A(t — 1) f(t — 1) shifts the graph of 
F(t) 1 unit to the right and then cuts off the resulting graph at t = 1 and replaces it 
with the line y = 0 fort < 1. < 


Functions of the form h(t — c) f(t — c), namely, translation of f by c and then 
truncation of the resulting graph for ¢ < c, as illustrated for ¢ = 1 in the previous 
example, are precisely the special type of functions in the Heaviside class H for 
which it is possible to compute the Laplace transform in an efficient manner. Since 
any piecewise-defined function will be reducible to functions of this form, it will 
provide an effective method of computation. Let us start by computing the Laplace 
transform of a translated Heaviside function h(t — c). 


Formula 6. If c > 0 is any nonnegative real number, verify the Laplace transform 
formula: 


Translates of the Heaviside function 


ese 


s>0. 


Lth(t —c)}(s) = 


% , 
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V Verification. For the Heaviside function h(t — c), we have 


CO 


L£ith(t —c)}(s) = fern —c)dt = i. dt 


0 Cc 
: ets r 
= lim 
ro —Ss 
4 
; eS _ e * e 
= lim = 
roo —Ss 


fors > 0. 
S 


Combining Formula 6 with linearity gives the following formula. 
Formula 7. If 0 < a < b < ow, then 


The on-off switch 


—as —bs 
£{x10,1)(t)} (8) = = : 


; s>0. 
KY 


Formula 6 is a special case of what is known as the second translation principle. 


Theorem 8. Suppose f(t) € H is a function with Laplace transform F(s). Then 


Second translation principle 


Lif (t —c)h(t —c)}(s) =e F(s). 


In terms of the inverse Laplace transform, this is equivalent to 


Inverse second translation principle 


Lo {e-° F(s)} = f(t —o)h(t —c). 


Proof. The calculation is straightforward and involves a simple change of variables 


[o) 


Lif(t—c)h(t —c)}(s) = agi —c)h(t —c) dt 


0 
oe) 


= fevse —c)dt 


Cc 
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fom roa (tttt+c) 
0 


co 


e* fe” f(t) dt 
| 
=e “F(s) Oo 


As with the notation used with the first translation theorem, it is frequently 
convenient to express the inverse second translation theorem in the following 
format: 

Lo {e F(s)} = h(t —c)L! 22) oe : 
That is, take the inverse Laplace transform of F(s), replace t by tf — c, and then 
multiply by the translated Heaviside function. 

In practice, it is more common to encounter expressions written in the form 
g(t)A(t — c), rather than the nicely arranged format f(t — c)h(t — c). But if f(t) 
is replaced by g(t +c) in Theorem 8, then we obtain the (apparently) more general 
version of the second translation principle. 


Corollary 9. 
Lig(thh(t—c)} =e Light +c}. 


A simple example of this occurs when g = 1. Then £ {A(t —c} =e *°£ {1} = 
e*°/s, which agrees with Formula 6 found above. When c = _ 0, then 
L{h(t —0)} = 1/s which is the same as the Laplace transform of the constant 
function 1. This is consistent since h(t — 0) = h(t) = 1 fort > 0. 

Now we give some examples of using these formulas. 


Example 10. Find the Laplace transform of 


? if 0O<t<1, 
f= . 


if l<t<w 


using the second translation principle. This Laplace transform was previously 
computed directly from the definition in Example 2. 


> Solution. In Example 3, we found f(t) = t? + (2—17)h(t — 1). By Corollary 9, 
we get 
3 


Lift= stereo + 1)} 


2 
= See {2+} 


Of 2 od 
“(CN ge eg < 
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Example 11. Find the Laplace transform of 


cost if O<t<z, 
f= 41 if m7 <t <2n, 


0 if 27 <t<o. 
> Solution. In Example 4, we found 
f(t) = cost + (1—cost)h(t — 2) —A(t — 2m). 


By Corollary 9, we get 


—2s0 
Ss 
F(s) = “7 CA t - 
(5) = Boy $e L EL — costt + x)} 
Ss a ae 1 rn Ss e72st 
= e* = ; 
s+] gs s*+1 s 
In the second line, we have used the fact that cos(t + 7) = —cost. 


Uniqueness of the Inverse Laplace Transform 


407 


Theorem 8 gives a formula for the inverse Laplace transform of a function e~** F(s). 
Such an explicit formula is suggestive of some type of uniqueness for the Laplace 
transform, that is, £{f(t)}} = Li{g(t)} = > f(t) = g(t), which is Theorem 1 
of Sect.2.5 for continuous functions. By expanding the domain of the Laplace 
transform £ to include the possibly discontinuous functions in the Heaviside class 
H, the issue of uniqueness is made somewhat more subtle because changing the 
value of a function at a single point will not change the integral of the function, and 
hence, the Laplace transform will not change. Therefore, instead of talking about 
equality of functions, we will instead consider the concept of essential equality of 
functions. Two functions f(t) and /o(t) are said to be essentially equal on [0, oo) 
if for each subinterval [0, V) they are equal as functions except at possibly finitely 


many points. For example, the functions 


1 if O<r<l, 


n=}! ssa ibin At =%3 if t=1, 


2 if l<t<o, 


2 if l<t<o, 


1 f0<r<1, 


2 ifl<t<o, 
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are essentially equal for they are equal everywhere except at t=1, where f\(1)=2, 
f:(1)=3, and f3(1)=1. Two functions that are essentially equal have the same 
Laplace transform. This is because the Laplace transform is an integral operator 
and integration cannot distinguish functions that are essentially equal. The Laplace 
transforms of f;(t), fo(t), and f3(¢) in our example above are all (1 + e~*)/s. Here 
is our problem: Given a transform, like (1 + e~*)/s, how do we decide what “the” 
inverse Laplace transform is. It turns out that if F'(s) is the Laplace transform of 
two functions fi(t), fo(t) € H, then f(t) and fo(t) are essentially equal. Since 
for most practical situations it does not matter which one is chosen, we will make 
a choice by always choosing the function that is right continuous at each point. A 
function f(t) in the Heaviside class is said to be right continuous at a point a if 
we have 


fla) = fla*) = lim, £0, 


and it is right continuous on [0,0o) if it is right continuous at each point in 
[0, co). In the example above, /((f) is right continuous while /)(t) and f3(t) are 
not. The function /3(t) is, however, left continuous, using the obvious definition of 
left continuity. If we decide to use right continuous functions in the Heaviside class, 
then the correspondence with its Laplace transform is one-to-one. We summarize 
this discussion as a theorem: 


Theorem 12. /f F(s) is the Laplace transform of a function in H, then there is a 
unique right continuous function f(t) € H such that L{f(t)} = F(s). Any two 
functions in H with the same Laplace transform are essentially equal. 


All the translates h(t — c) of the Heaviside function A(t) are right continuous, 
so any piecewise function written as a sum of products of a continuous function 
and a translated Heaviside function are right continuous. In fact, the convention of 
using right continuous functions just means that the inverse transforms of functions 
in H will be written as sums of f(t — c)h(t — c), as given in the second translation 
principle Theorem 8. 


Example 13. Find the inverse Laplace transform of 
eo 2: es 
sz s—4 


F(s) = 


and write it as a right continuous piecewise-defined function. 


> Solution. The inverse Laplace transforms of 1/s? and 1/(s—4) are, respectively, 
t and e*’. By Theorem 8, the inverse Laplace transform of F(s) is 


LU {F(s)} = AG -—1) £7 =} + h(t —3) £7 ia} 


t>t-l 


=hO=1) Olio: + hE =3) (€*)|,_4-, 
= (t—1h(t —1) +e nt — 3). 


t>t-3 
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On the interval [0, 1), both t — 1 and e*’—*) are off. On the interval [1, 3) only t — 1 
is on. On the interval [3, 00), both t — 1 and e*”—) are on. Thus, 


0 if 0<t<1 
LO LEGS S83 pS if L2t<e3:. < 


t—-1l+te-) if 3<t<oo 
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6.2 The Heaviside Class H. 411 
Exercises 


1-8. Graph each of the following functions defined by means of the unit step 
function h(t — c) and/or the on-off switches ja, p). 


1. f(t) = 3h(t —2) —h(t —5) 

. f(t) = 2h(t — 2) — 3h(t — 3) + 4h(t — 4) 

. f(t) =@¢-DAC-) 

. f(t) = (t —2)7h(t — 2) 

. f(t) = t?h(t — 2) 

. f(t) = h(t — 2) sint 

. f(t) = h(t — 1) cos2(t — 7) 

8. f(t) = tx, y(t) + 2—1)xp,.30) + 37, c0)(t) 


9-27. For each of the following functions f(t), (a) express f(t) in terms of on-off 
switches Yja,p)(t), (b) express f(t) in terms of translates h(t — c) of the Heaviside 
function h(t), and (c) compute the Laplace transform F(s) = £{ f(t)}. 


NY Dn wn fF W WY 


0 if0<t<2 
9. ft)= 
t—-2 if2<t<o 
0 if0<t<2 
10. f7@H=2° "= 
t if2<t<o 
ifO0<t<2 
meee. “Ste 
t+2 if2<t<o@ 
ifO0<t<4 
2. fi) =? ee 
(t—4) if4<t<o 
0 fO0<t<4 
13. fO=), | 
tt if4<t<c 
0 if0<t<4 
M4. fO=), 
t--4 if4<t<o 
0 if0<t<2 
15. f(t) = cial 
(t—4)? if2<t<oo 
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17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 
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0 if0<t<4 


e+ if4<t<oc 


0 if0<t<4 


e if4<t<o 


0 if0<t<6 


e+ if6<t<c 


0 if0<t<4 


te’ if4<t<oo 


1 if 0<t<4 
-l if 4<t<5 
0 if 5<t<o 


t if O<t<l 
2-t if l1<t<oo 


if 2<t<o 


t? if 0<t<2 
4 if 2<t<3 


7-t if 3<t<o 


1 if 0<t<2 
3-t if 2<t<3 
2¢-—3) if 3<t<4 
2 if 4<t<@w 


t if 0O<t<l 
t-1 if l<t<2 
t-2 if 2<t<3 


| 
| 
| 
| 
| 
| 
fof Ae 
| 
| 


6.2 


26 


27 


The Heaviside Class H. 
1 if 2n<t<2n+1 
ft) = 
0 if 2n+1<t<2n+2 
l1-t if O0O<t<2 
_ if 2<t<4 
A 
£0 5-t if 4<t<6 
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28-42. Compute the inverse Laplace transform of each of the following functions. 


28. 


29. 


30. 


31. 


32. 


33. 


34, © 


35. 


G=1? 


irs 


e 
s2?+1 


seo 


s2 +1 


TS 


e 
s?+25+5 


36. ——— 


37; 


38. 


—As 


s2+35+2 


es 4 es 
s*—35 +2 
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1 —eo 
20. 
1 —3s 
46. 228 
gt 
2st 
41. aang. 
2 +6s+13 
Qs+1 
CCT | Ce eon a 
+6413 


43-44. These exercises show that the Heaviside class H is a linear space. 


43. Suppose f; and f are piecewise continuous on [0, 00) andc € R. Show ff + 
cf is piecewise continuous on [0, co). 


44. Suppose fi, fo € H andc € R. Show that f, + cfr € H and hence, H is a 
linear space. 


6.3 Laplace Transform Method for f(t) © H 415 
6.3 Laplace Transform Method for f(t) € H 


The differential equations that we will solve by means of the Laplace transform are 
first and second order constant coefficient linear differential equations with a forcing 
function f(t) € H: 
y'+ay= f), 
y" tay’ + by = fo. 


To employ this method, it will be necessary to compute the Laplace transform of 
derivatives of functions in 1. That is, we need to know the extent to which the input 
derivative formula 
Lif} = sL{fO}—- £O) 

is valid when f(t) is in the Heaviside class H. Recall that for f(t) € H, the symbol 
J’ (£) is used to denote the derivative of f(t) if f(t) is differentiable except possibly 
at a finite number of points on each interval of the form [0, NV]. Thus, f’(t) will be 
(possibly) undefined for finitely many points in [0, NJ]. 


Example 1. Verify that the input derivative formula is not valid for the on-off 
switch function 
1 if0<r<1, 


FO= MO = 1) seed. 


V Verification. From the definition, it is clear that f’(t) = 0 for all t 4 1; it is 
not differentiable, or even continuous, at t = 1. Thus, £ { f’(t)} = 0. However, by 
Formula 7 of Sect. 6.2, £{ f(t)} = F(s) = (1 —e~*)/s so that 


sF(s)— f() =1-e*%-1l=e* A0=L{f'(}. A 


Example 2. Verify that the input derivative formula is valid for the following 
function 
1 if0<r <1, 
ft) = 
t ift>1. 
See Fig. 6.11 


V Verification. Write f(t) in the standard form using translates of the Heaviside 
function h(t) to get 


f@) = xo.yn) + th -1) =14+(-DAC- 1). 
Thus, 


sF(s) — f() = (; n ;) -1= = £tht-D}= Lf"), 


since f’(t) = h(t — 1). Therefore, the input derivative principle is satisfied for this 
function f(t). A 
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Fig. 6.11 A continuous f(t) 


¥ ¥ 
with discontinuous derivative 3 * 3 ‘ 
2 2 
1 1 
>t ee >t 
2 3 i 2 3 
y= fi y= fi(t) 


Thus, we have an example of a piecewise continuous function (Example |) for 
which the input derivative principle fails, and another example (Example 2) for 
which the input derivative principle holds. What is the significant difference between 
these two simple examples? For one thing, the second example has a continuous 
F(t), while that of the first example is discontinuous. It turns out that this is the 
feature that needs to be included. That is, the derivative need not be continuous, but 
the function must. 


Theorem 3. Suppose f(t) is a continuous function on [0, 00) such that both f(t) 
and f'(t) are in H. Then 


The input derivative principle 
The first derivative 


LIF (O} (9) = sL{f(O} (9) — FO). 


Proof. We begin by computing i e f(t) dt. This computation requires a 
careful analysis of the points where f’(t) is discontinuous. There are only finitely 
many such discontinuities on the interval [0, NV), which will be labeled a), ..., ax, 
and we may assume a; < d;+1. If we let ag = 0 and ag4; = N, then we obtain 


N k ai+1 
i e f(t) dt = ae a" Pad, 


and integration by parts gives 


N k 4j+1 


fero dt = > poe 45 / e! f(t) dt 
0 i=0 qj 
k N 
= Pfae ye = flatyen) +s fem" fear 


i=0 0 
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k N 
= V(faisve*t! — flaie*”) +s / e" f(t) dr 
1=0 0 
N 
= f(N)e’’ — £0) +5 / ent f(t) de. 


0 


Since f(t) is continuous, we have flay) = f(a) and f(aj,,) = f(ai+i) which 
allows us to go from the second to the third line. The telescoping nature of the sum 
in line 3 allows it to collapse to f(az4,)e"+! — f(an)e*" = f(N)e™* — f (0) 
which produces the final line. Now take the limit as N goes to infinity and the result 
follows. Oo 


If f(t) € H, then the definite integral g(t) = i f(u) du is continuous, in 
the Heaviside class, and moreover, g(0) = 0. Thus, applying the input derivative 
principle to the function g(t) € H gives the input integral principle: 


Corollary 4. Suppose f(t) is a function defined on [0,00) such f(t) € H, and 
F(s) = L{f(t)} (s), then 


The input integral principle 


£}f fay aul (s) = EY 


5 


The second order input derivative principle is an immediate corollary of the first, 
as long as we are careful to identify the appropriate hypotheses that f(t) must 
satisfy. 


Corollary 5. If f(t) and f'(t) are continuous and f(t), f'(t), and f(t) are in 
H, then 


Input derivative principle 


The second derivative 


Lif" O)} =P L{FO} — sfO) — f'O). 


We are now in a position to illustrate the Laplace transform method for solving 
first and second order constant coefficient differential equations 


y’ tay = f(t), 
y" +ay’ + by = f(t) 
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with a forcing function f(t) that is possibly discontinuous. In order to apply the 
Laplace transform method, we will need to take the Laplace transform of a potential 
solution y(t). To apply the input derivative formula to y(t), it is necessary to know 
that y(t) is continuous and y’(t) € H for the first order equation and both y(t) and 
y’(t) are continuous while y”(t) € H for the second order equation. These facts 
were proved in Theorems 5 and 7 of Sect. 6.1, and hence, these theorems provide 
the theoretical underpinnings for applying the Laplace transform method formally. 
Here are some examples. 


Example 6. Solve the following first order differential equation: 
y+2=fO0, yOQ=1, 


where 
0 iif O0<tr<tl, 


t if l<t<ow. 


fO= | 
> Solution. We first rewrite f(t) in terms of Heaviside functions: 


SOQ =txn(t) =th(t—1. 


By Corollary 9 of Sect. 6.2 of the second translation principle, its Laplace trans- 
form is 


F(s) = Litht —D}=e*lLit+ly=e* ( : + -) =e" (- = | . 
Ss R) Ss 
Let Y(s) = £ {y(t)} where y(¢) is the solution to the differential equation. Since the 
analysis done above shows that y(f) satisfies the hypotheses of the input derivative 
principle, we can apply the Laplace transform to the differential equation and 
conclude 


_, [st] 
sY(s) — y(0) + 2Y(s) =e* ( 2 ) : 
Solving for Y(s) gives 


stl 


Y(s) = 2642) 


——4te’* 
s+2 


A partial fraction decomposition gives 


s+l1 eo ee 1 1 
S(s+2) 45 2582 4542’ 
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Fig. 6.12 The graph of the y 
solution to Example 6 Qh 
1 
(0) 1 i t 
0 al 2 3 4 


and the second translation principle (Theorem 8 of Sect. 6.2) gives 


1 1 1) 1 1) 1 1 
Lo a ae —s > fo! —-s- { po} —s 
toa} +3 fe sles © ef 4a° Ve saa 


1 1 1 
=e 4 -A(t —1) + =(t — A(t — 1) — -e 2" Pace — 1). 
e a a Darah )h(t — 1) ae ( ) 


y(t) 


e 7 if 0<t<1 

1 1 
eo + -(2t-1)—-e7"-) if 1<t<oo. 

4 4 
The graph of y(t) is shown in Fig. 6.12, where the discontinuity of the forcing 
function f(t) at time ¢ = 1 is reflected in the abrupt change in the direction of 
the tangent line of the graph of y(t) att = 1. < 


We now consider a mixing problem of the type mentioned in the introduction to 
this chapter. 


Example 7. Suppose a tank holds 10 gal of pure water. There are two input sources 
of brine solution: the first source has a concentration of 2 lbs of salt per gallon while 
the second source has a concentration of 3 lbs of salt per gallon. The first source 
flows into the tank at a rate of 1 gal/min for 5 min after which it is turned off and 
simultaneously the second source is turned on at a rate of 1 gal/min. The well-mixed 
solution flows out of the tank at a rate of 1 gal/min. Find the amount of salt in the 
tank at any time t. 


> Solution. A pictorial representation of the problem is the following diagram. 


Salt Mixture 1 | | Salt Mixture 2 


0.5 Ibs/Gal; 1 Gal/min 2.5 lbs/Gal; 1 Gal/min 
0<t<5 t>5 


| 1 Gal/min 
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Letting y(t) denote the amount of salt in the tank at time f, measured in pounds, 
apply the fundamental balance principle for mixing problems (see Example 11 
of Sect. 1.4). This principle states that the rate of change of y(t) comes from the 
difference between the rate salt is being added and the rate salt is being removed. 
Symbolically, 

y’(t) = rate in — rate out. 


Recall that the input and output rates of salt are the product of the concentration 
of salt and the flow rates of the mixtures. The rate at which salt is being added 
depends on the interval of time. For the first five minutes, source one adds salt at 
a rate of 0.5 lbs/min, and after that, source two takes over and adds salt at a rate of 
2.5 Ibs/min. Since the flow rate in is | gal/min, the rate at which salt is being added 
is given by the function 


05 if O<t <5, 
2.55 if 5<t<oo. 


f(t) = 


The concentration of salt at time ¢ is y(t)/10lbs/gal, and since the flow rate out is 
1 gal/min, it follows that the rate at which salt is being removed is y(t)/10 Ibs/min. 
Since initially there is pure water, it follows that y(0) = 0, and therefore, we have 
that y(t) satisfies the following initial value problem: 


y(t) 


y=fo- 0 y(0) = 0. 


Rewriting f(t) in terms of translates of the Heaviside function gives 


S(t) = 0.5y>0,5)(t) + 2.5 755,00) (t) 
= 0.5(h(t) — h(t — 5)) + 2.5h(t — 5) 
= 05 DnG 5): 


Applying the Laplace transform to the differential equation and solving for Y(s) = 


Liy(t)} (s) gives 
HAS ( 1 (S*) 
S+ TO s 


6.3. Laplace Transform Method for f(t) € H 421 


25 


20 F 


0 ; ; , >t 
0 5 10 15 20 25 


Fig. 6.13 The solution to a mixing problem with discontinuous input function 


Taking the inverse Laplace transform of Y(s) gives 


y(t) = 5—5e* + 20h(t — 5) — 20e7 h(t — 5) 
_ $5 —5e7%6 EUs? <5, 


t=—5 


$95 Seth 200 SS <t < cw. 


The graph of y is given in Fig.6.13. As expected, we observe that the solution 
is continuous, but the kink at tf = 5 indicates that there is a discontinuity of the 
derivative at this point. This occurred when the flow of the second source, which 
had a higher concentration of salt, was turned on. < 


Here is an example of a second order equation. 


Example 8. Solve the following second order initial value problem 


y” + 4y = f(t), y(0) =0, y’'(0) = 1 


where 
1 if0<t<aZ, 


fO= 


sint iff >7z. 


> Solution. First note that 


f(t) 


Xo. x) (t) + (sin t) X{x, 00) (t) 
= 1-A(t —z) + (sint)h(t — 2), 
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so that 


F(s) =LifOs 
1 —Ts 


eee +e CL {sin(t + 2)} 
s 


s 
1 e 

= 7-7 +e *L {—sint} 
s s 

= i ents eae 
s s se41 


Letting Y(s) = £ {y(t)} (s), where y(t) is the solution to the initial value problem, 
and taking the Laplace transform of the differential equation gives 


—Ts 1 


1 e 
2 —ms 
s“Y(s) —-1+4Y(s) = _ +e . 
(s) (s) AY S sz+]1 


Now solve for Y(s) to get 


1 1 
AS l—-e7) +e" : 
s?7+4  s(s?+4) ( ) (s?2 + 1)(s? + 4) 


Y(s) = 


The solution is completed by taking the inverse Laplace transform, using the second 
translation theorem: 


y(t) = £7" {¥(s)} 


eae i Se ne = 

= 5 sin2r+L£ aaa} h(t—m)L lca} « 1) 
-1 

te -9 aaTareal O-. 


Computing the partial fractions in the usual manner 


and 


1 i is 
s(s?+4) 5 s?+4 
1 1 
— 3 a 
(s?+1)(s2?+4)  s?4+1. 9244 


and substituting these into the inverse Laplace transforms gives 
(t) zd 2t+ ae 2t ne xe! 2(t )) 
= —sin —— —cos2t — —h(t —m) (1—cos2(t—z 
‘ 2 4.4 4 


+5h(e —T) (sinc —)- sin 2(t — x)) : 
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y y 
1 1 
0 >t 0 : : > ¢ 
T 20 37 T 20 37 
—1 -1 
y(t) y! (t) 


Fig. 6.14 The graph of the solution y(t) to Example 8 is shown along with the graph of the 
derivative y’(t). Note that the derivative y’(t) is continuous, but it is not differentiable at t = z, 
signifying that the second derivative y”’ (¢) is not continuous at tf = 2 


Evaluating this piecewise gives 


+ sin 2t + 4—4cos2t if0<t<17Z, 
yt) = 


—fsint + }sin2z ift >a. 


The graph of the solution y(t) and its derivative y’(t) are given in Fig. 6.14. < 
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Exercises 


1-12. Solve each of the following initial value problems. 


0 if0<t<1l 
lw +2y= , y(0)=0 
— ift>1 
if0<t<l 
2. y' +5y= , yO) =1 
; ift >1 


if O27 = 3 
3. y' -3y= if2<t<3, y(0)=0 
if t >3 


if0<t<1 
4. y'+2y , y(0)=0 
ifl<t<o@ 


12e if0<t<1 
5. y =4y = , y(0O)=2 
12e ifl<t<o 


6. y'+3y = 


10sint ifO0<t<az 
. 7 y(0) =- 


ifm#<t<c 


7. y” +9y = h(t —3), y(0) =0, y'(0) =0 


1 if0<t<5 

8. y"—Sy’t4ya=q N=! <?) yO) =0, y=! 
0 ift>5 
0 fO0O<t<i1 

9. y"+5y'+6y=46 ifl<t<3, y(O)=0, y'(0)=0 
0 ift>3 


10. y+ 9y = h(t —27)sint, y(0)=1, y’(0) =0 
Il. y”+2y’+y=hA(t—3), y(0)=0, y/(0) =1 


— if0<t<4 
12, y’+2y+y= 5 vedeee y(0) = 0, y’(0) = 0 
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13-15. Mixing Problems 


13. Suppose a tank holds 4 gal of pure water. There are two input sources of brine 
solution: the first source has a concentration of | 1b of salt per gallon while the 
second source has a concentration of 5 lbs of salt per gallon. The first source 
flows into the tank at a rate of 2 gal/min for 3 min after which it is turned off, 
and simultaneously, the second source is turned on at a rate of 2 gal/min. The 
well-mixed solution flows out of the tank at a rate of 2 gal/min. Find the amount 
of salt in the tank at any time t. 

14. Suppose a tank holds a brine solution consisting of 1 kg salt dissolved in 4L 
of water. There are two input sources of brine solution: the first source has a 
concentration of 2 kg of salt per liter while the second source has a concentration 
of 3 kg of salt per liter. The first source flows into the tank at a rate of 4 L/min 
for 5 min after which it is turned off, and simultaneously, the second source is 
turned on at a rate of 4 L/min. The well-mixed solution flows out of the tank at 
a rate of 4L/min. Find the amount of salt in the tank at any time t. 

15. Suppose a tank holds a brine solution consisting of 2 kg salt dissolved in 10L 
of water. There are two input sources of brine solution: the first source has a 
concentration of 1 kg of salt per liter while the second source is pure water. 
The first source flows into the tank at a rate of 3 L/min for 2 min. Thereafter, 
it is turned off and simultaneously the second source is turned on at a rate of 
3 L/min for 2 min. Thereafter, it is turned off and simultaneously the first source 
is turned back on at a rate of 3 L/min and remains on. The well-mixed solution 
flows out of the tank at a rate of 3 L/min. Find the amount of salt in the tank at 
any time t. 

16. Suppose a # 0. Show that the solution to 


y’ +ay = Axa), y(0) = yo 
iS 
0 if 0<t <a, 
—at A — — . 
y(t) = yoe a 1 —e 4-4) ifa<t<fB, 


eB) _ e-all—2) if B<t < 00. 
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6.4 The Dirac Delta Function 


In applications, we may encounter an input into a system we wish to study that 
is very large in magnitude, but applied over a short period of time. Consider, for 
example, the following mixing problem: 


Example 1. A tank holds 10 gal of a brine solution in which each gallon contains 
2 Ibs of dissolved salt. An input source begins pouring fresh water into the tank at a 
rate of 1 gal/min and the thoroughly mixed solution flows out of the tank at the same 
rate. After 5 min, 3 lbs of salt are poured into the tank where it instantly mixes into 
the solution. Find the amount of salt in the tank at any time f. 


This example introduces a sudden action, namely, the sudden input of 3 lbs of 
salt at time tf = 5 min. If we imagine that it actually takes 1 second to do this, then 
the average rate of input of salt would be 3 lbs/s = 1801bs/min. Thus, we see a 
high magnitude in the rate of input of salt over a short interval. Moreover, the rate 
multiplied by the duration of input gives the total input. 

More generally, if r(¢) represents the rate of input over a time interval [a, b], then 
i r(t) dt would represent the total input. A unit input means that this integral is 1. 
Let tf = c = O be fixed and let € be a small positive number. Imagine a constant 
input rate over the interval [c, c + €) and 0 elsewhere. The function d..< = t Xe,ete) 
represents such an input rate with constant input 1/e over the interval [c, c + €) (cf. 
Sect. 6.2 where the on-off switch yja,5) is discussed). The constant 1/¢ is chosen so 
that the total input is 


ioe) cte 
1 1 
[aca =- / ldt = -e=1. 
€ € 
0 c 
For example, if é = a min, then 3d; would represent the input of 3 Ibs of salt over 


a l-s interval beginning at f = 5. 

Figure 6.15 shows the graphs of d,.. for€ = 2, 0.5, and 0.1. The area of the 
region under each line segment is |. The main idea will be to take smaller and 
smaller values of €, that is, we want to imagine the total input being concentrated 
at the point c. We would like to define the Dirac delta function by 6,.(t) = 
lim,_,o+ de.<(t). However, the pointwise limit would give 


8.(t) = ‘= if t=c, 


0 elsewhere. 


In addition, we would like to have the property that 


[o,) lo ) 
[soar = tim [dex dt = 1. 
0 0 
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Fig. 6.15 Approximation to a delta function 


Of course, there is really no such function with this property. (Mathematically, 
we can make precise sense out of this idea by extending the Heaviside class to 
a class that includes distributions or generalized functions. We will not pursue 
distributions here as it will take us far beyond the introductory nature of this text.) 
Nevertheless, this is the idea we want to develop. We will consider first order 
constant coefficient differential equations of the form 


y'+ay = f(), 
where f involves the Dirac delta function 6,. It turns out that the main problem lies 
in the fact that the solution is not continuous, so Theorem 3 of Sect. 6.3 does not 
apply. Nevertheless, we will justify that we can apply the usual Laplace transform 
method in a formal way to produce the desired solutions. The beauty of doing this 
is found in the ease in which we can work with the “Laplace transform” of 6. 
We define the Laplace transform of 5, by the formula: 
Li{6.} = lim Lidee}. 
Theorem 2. The Laplace transform of 8¢ is 


Lie 


Proof. We begin with d,.¢: 


Efdec} = L{hlt — 0) — he -6- 9} 


1 fe — e cte)s 
= 
ees (1 —e7s 

a oce 
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We now take limits as € goes to 0 and use L’ Hospital’s rule to obtain: 


—cs l—e® 
Lib} = lim £ {dee} =< (im = ) = ‘s=e, Oo 
—s Ss 


We remark that when c = 0 we have £ {59} = 1. By Proposition | of Sect. 6.2, 
there is no Heaviside function with this property. Thus, to reiterate, even though 
L {6.} is a function, 6, is not. We will frequently write 6.(¢) = 6(t —c) and 6 = do. 

The Dirac delta function allows us to model the mixing problem from Example | 
as a first order linear differential equation. 


> Solution. Setting up the differential equation in Example 1: Let y(t) be the 
amount of salt in the tank at time t. Then y(0) = 20 and y’ is the difference of 
the input rate and the output rate. The only input of salt occurs at t = 5. If the salt 
were input over a small interval, [5,5 + €) say, then 2 X[5.5+«) would represent the 
input of 3lbs of salt over a period of € minutes. If we let € go to zero, then 345 
would represent the input rate. The output rate is y(t)/10. We are thus led to the 
differential equation: 


yt 2 = 38s, (0) = 20. 


The solution to this differential equation will continue below and fall out of the 
slightly more general discussion we now give. < 


Differential Equations of the Form y’ +ay = k6, 


We will present progressively three procedures for solving 

y’ tay =ké&, y(0) = yo. (1) 
The last one, the formal Laplace transform method, is the simplest and is, in part, 
justified by the methods that precede it. The formal method will thereafter be used 
to solve (1) and will be extended to second order equations. 


Limiting Procedure 


In our first approach, we solve the equation 


k 
y +ay= edlecto y(0) = yo 
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and call the solution y.. Since 6. = lime+o a Kinekes we let y(t) = lime+o ye. 
Then y(t) will be the solution to y’ +ay = k6., y(0) = yo. We will assume a 4 0 
and leave the case a = 0 to the reader. Recall from Exercise 16 of Sect. 6.3 the 
solution to 


y’ +ay = Axfa,B), yO) = yo, 
is 
A 0 if O<t <a, 
y(t) = yore + a 1—e4t-%) ifa<t<B, 


et-B) _ eal) if B<t <0. 


We let A = Ka =c,and B =c +€ to get 
0 if O<t<c, 
—at k . 
Ye(t) = yore“ + = 1 —e4l—e) ifc<t<c+e, 


ealt—e—e) _ ealt—e) if CLE <t <0. 


The computation of lim,_.9 y- is done on each interval separately. If 0 < t < c, 
then ye = yoe “ is independent of €, and hence, 


lim y(t) = yor 0<t<c. 


If c <t < ©, then for € small enough, c + € < ¢ and thus 


ae 
ye(t) = yor“ + Butea — el) = yor + K ato) — 1 
ae a z 
Since lim;+< = a, we get 
lim ye(t) = yor + ke“, C<t<oo. 
e>0 


We thus obtain 


@) yor if 0 < t = c, 
y = 
yor O+ke "9 if c<t<o. 


Observe that there is a jump discontinuity in y(t) at ¢ = c with jump k. 


Extension of Input Derivative Principle 


In this method, we want to focus on the differential equation, y’ + ay = 0, on the 
entire interval [0, oo) with the a priori knowledge that there is a jump discontinuity 
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in y(t) att = c with jump k. Recall from Theorem 3 of Sect. 6.3 that when y is 
continuous and both y and y’ are in H, we have the formula 


L{y'} (s) = s¥(s)— y). 
We cannot apply this theorem as stated for y is not continuous. But if y has a single 
jump discontinuity at t = c, we can prove a slight generalization. 


Theorem 3. Suppose y and y’ are in H. and y is continuous except for one jump 
discontinuity at t = c with jump k. Then 


L {y’} (s) = sY¥(s) — y(0) —ke™. 
Proof. Let N > c. Then integration by parts gives 


N c N 


fevy'oa - fevyoa + fevyoa 


0 0 Cc 
=e" y(OIo +5 feyaar 
0 
N 
+e y(t)| +5 fe“ yaar 

N 
=s / e y(t) dt +e" y(N) — y(0) 

0 


—e*(y(ct) — y(c")). 


We take the limit as N goes to infinity and obtain 


L{y'} = s£L{y}-— yO) —ke™, 
where k = y(ct) — y(c_) is the jump of y(t) att =c. Oo 
We apply this theorem to the initial value problem 
y'+ay=0, — y(0) = yo 


with the knowledge that the solution y has a jump discontinuity at t=c with jump k. 
Apply the Laplace transform to the differential equation to obtain 


sY(s) — y(0) —ke~% + aY(s) = 0. 
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Solving for Y gives 
Yo cs: 
Sta Sta 


Applying the inverse Laplace transform gives the solution 


Y(s) = 


y(t) = yoo + ke "A(t — c) 


yor “ if 0<t<c, 


ye +ke tif e<t < oo. 


The Formal Laplace Transform Method 
We now return to the differential equation 
y' tay =ké:, y(0) = yo 


and apply the Laplace transform method directly. From Theorem 2, the Laplace 
transform of k6é, is ke~°*. This is precisely the term found in Theorem 3 where 
the assumption of a single jump discontinuity is assumed. Thus, the presence of 
k6,- automatically encodes the jump discontinuity in the solution. Therefore, we can 
(formally) proceed without any advance knowledge of jump discontinuities. The 
Laplace transform of 


y tay=ké.,  y0)=yo 


gives 
sY(s)— y(0) + aY(s) = ke. 


Solving for Y(s), we get 


Yo k ees 


Y(s) = + : 
Sta S+a 


Apply the inverse Laplace transform as above to get 


() yor if 0<t<c, 
y — 
ye O +ke "9 if c<t <a. 


Observe that the same result is obtained in each procedure and justifies the formal 
Laplace transform method, which is thus the preferred method to use. We now use 
this method to solve the mixing problem given in Example 1. 


> Solution. We apply the Laplace transform method to 


ie ¥ 
— = 36s, 0) = 20 
¥ +76 5 y(0) 
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Fig. 6.16 Graph of the solution to the mixing problem 


to get 
1 
sY(s) —20+ 70% = 3e°5, 


Solving for Y(s) gives 
20 3e°% 
Y(s) = cr i 
S+ To S+ To 


and Laplace inversion gives 


y(t) = 20e*/ + 39-9) ¢ — 5) 
_ \20e8 if O<t <5, 


~ )20e7#/19 4. 3e-@-9)/10 if 5 < tt < 00. 


The graph is given in Fig. 6.16 where the jump of 3 is clearly seen at t = 5. < 


Impulse Functions 


An impulsive force is a force with high magnitude introduced over a short period of 
time. For example, a bat hitting a ball or a spike in electricity on an electric circuit 
both involve impulsive forces and are best represented by the Dirac delta function. 
We consider the effect of the introduction of impulsive forces into spring systems 
and how they lead to second order differential equations of the form 


my" + py’ +ky = K6,(t). 
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As we will soon see, the effect of an impulsive force introduces a discontinuity not 
in y but its derivative y’. 

If F(t) represents a force which is 0 outside a time interval [a,b], then 
f F(t)dt = f Die (t) dt represents the total impulse of the force F(t) over that 
interval. A unit impulse means that this integral is 1. If F is given by the acceleration 
of a constant mass, then F(t) = ma(t) = my"(t), where m is the mass and 
a(t) = y”(t) is the acceleration of the object given by the position function y(t). 
The total impulse 


b b 


[Fo dt = [nae dt = my'(b) — my’(a) 


a a 


represents the change of momentum. (Momentum is the product of mass and 
velocity). Now imagine a constant force is introduced over a very short period of 
time with unit impulse. We then model the force by d... = t Xiccte). Letting € go to 
0 then leads to the Dirac delta function 6, to represent the instantaneous change of 
momentum. Since momentum is proportional to velocity, we see that such impacts 
lead to discontinuities in the derivative y’. 


Example 4 (See Sect. 3.6 for a discussion of spring-mass-dashpot systems). A 
spring is stretched 49 cm when a | kg mass is attached. The body is pulled to 
10 cm below its spring-body equilibrium and released. We assume the system is 
frictionless. After 3s, the mass is suddenly struck by a hammer in a downward 
direction with total impulse of 1 kg-m/s. Find the motion of the mass. 


> Solution. Setting up the differential equation: We will work in units of kg, m, 


and s. Thus, the spring constant k is given by 1(9.8) = ks, so that k = 20. An 


external force to the system occurs as an impulse at tf = 3 which may be represented 
by the Dirac delta function 63. The initial conditions are given by y(0) = 0.10 and 
y’(0) = 0, and since the system is frictionless, the initial value problem is 


y” + 20y = 83, y(0)=0.10, y’(0) =0. 


We will return to the solution of this problem after we discuss the more general 
second order case. < 


Equations of the Form y” + ay’ + by = K6, 
Our goal is to solve 


y” tay’ +by = Kb, yO=y, YO=N (2) 
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using the formal Laplace transform method discussed above for first order differ- 
ential equations. As we discussed, the effect of K6, is to introduce a single jump 
discontinuity in y’ att = c with jump K. Therefore, the solution to (2) is equivalent 
to solving 

y” tay’ +by =0 


with the advanced knowledge that y’ has a jump discontinuity at t = c. If we apply 
Theorem 3 to y’, we obtain 


L£{y"} = s£{y'}— y'(0) - Ke 
= s*¥(s) — sy(0) — y'(0) — Ke. 
Therefore, the Laplace transform of y” + ay’ + by = 0 leads to 
(s* + as + b)Y(s) — sy(0) — y'(0) — Ke" = 0. 


On the other hand, if we (formally) proceed with the Laplace transform of (2) 
without foreknowledge of discontinuities in y’, we obtain the equivalent equation 


(s? + as + b)Y(s) — sy(0) — y'/(0) = Ke. 


Again, the Dirac function 6, encodes the jump discontinuity automatically. If we 
proceed as usual, we obtain 


sy(0) + y’(0) Ke*¢ 
srtas+hb setastb 


Y(s) = 


The inversion will depend on the way the characteristic polynomial factors. 
We now return to Example 4. The equation we wish to solve is 


y” + 20y = 83, y(0) =0.10, y’(0) =0. 
> Solution. We apply the formal Laplace transform to obtain 


O.1s de e735 
s2?+20  52+20° 


Y(s) = 
The inversion gives 


y(t) = cos (201) ae sin (20 - 3)) h(t — 3) 


if 0<t <3, 


1 
= — cos (V20r) + sin (20 (r —3)) if 3<t<o. 


10 


g 8 
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Fig. 6.17 Harmonic motion with impulse function 


Figure 6.17 gives the graph of the solution. You will note that y is continuous, but 
the little kink at t = 3 indicates the discontinuity of y’. This is precisely when the 
impulse to the system was delivered. < 
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Exercises 
1-10. Solve each of the following initial value problems. 
1. y'+2y=6,(t), y(0)=0 
2. y' —3y =34+6,(t), y()=-1 
3. y'—4y = 84(t), (0) =2 
4. y’+y =41(1)— 634), y(0) =0 
5S. y” +4y =67(t), y(0) =0, y’(0) = 1 
6. y”—-y=51(t1)—-&(t), yO) =0, y’(O) =0 
7. y” +4y’ + 3y = 26(t), y(0)=1, y’(0) =-1 
8. y" + 4y = 62 (0) — bart), y(0) = 1, y'(0) = 0 
9. y” +4y’ + 4y = 361(t), yO) =—1, y’(0) = 3 
10. y” + 4y’ + 5y = 36,(t), y(0)=0, y’(0) = 1 


11-13. Mixing Problems. 


11 


12 


13 


. Suppose a tank is filled with 12 gal of pure water. A brine solution with 
concentration 2 lbs salt per gallon flows into the tank at a rate of 3 gal/min and 
the well-stirred solution flows out of the tank at the same rate. In addition, at 
t = 3min, 4lbs of salt is instantly poured into the tank where it immediately 
dissolves. Find the amount of salt, y(t), in the tank at any time f. 

. A tank holds 10L of a brine solution in which each liter contains 1 kg of 
dissolved salt. A brine solution with concentration 0.5 kg/L is poured into the 
tank at a rate of 2L/min, and the thoroughly mixed solution flows out of the 
tank at the same rate. After 2 min, | L of salt is poured into the tank where it 
instantly mixes into the solution. Find the amount of salt, y(¢), in the tank at 
any time f¢. 

. A tank holds | gal of pure water. Pure water flows into the tank at a rate of 
1 gal/min, and the well-stirred mixture flows out of the tank at the same rate. At 
t = 0,2,4,6 min, | lb of salt is instantly added to the tank where it immediately 
dissolves. Find the amount, y(t), of salt in the tank at time t. How much salt is 
in the tank just after the last addition at t = 6 min? 


14-17. Spring Problems 


14 


15 


. A spring is stretched 6in. when a 1-lb object is attached. The 1-lb object is 
pulled to 12in. below its spring-body equilibrium and released. We assume 
the system is frictionless. After 52 seconds, the mass is suddenly struck by 
a hammer in a downward direction with total impulse of | slug -ft/s. Find the 
motion of the object. Determine the amplitudes before and after the hammer 
impact. 

. A spring is stretched | m by a force of 8N. A body of mass 2kg is attached 
to the spring with accompanying dashpot. Suppose the damping force of the 
dashpot is 8N when the velocity of the body is 1 m/s. At t = 0, the mass is 
pulled down from its equilibrium position a distance of 10cm and given an 
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16. 


17. 


6 Discontinuous Functions and the Laplace Transform 


initial downward velocity of 5cm/s. After 4s, the mass is suddenly struck by a 
hammer in a downward direction with total impulse of 2 kg-m/s. Determine the 
resulting motion. 

A 1-Newton force will stretch a spring 1m. A body of mass 1 kg is attached 
to the spring and allowed to come to rest. There is no dashpot. At time t = 
0, 27,42, 62, a hammer impacts the mass in the downward direction with a 
magnitude of | kg m/s. Find the equation of motion and provide a graph on the 
interval [0, 10z:). 

A 1-Newton force will stretch a spring 1m. A body of mass 1 kg is attached 
to the spring and allowed to come to rest. There is no dashpot. At time ft = 
0, a, 27, 32,422,572, a hammer impacts the mass in the downward direction 
with a magnitude of 1 kg m/s. Find the equation of motion and provide a graph 
on the interval [0, 677). Explain. 


18-20. In these problems, we justify the Laplace transform method for solving 
y’ +ay = ké,, y(0) = yo in a way different from the limiting procedure and the 
extension of the input derivative principle introduced in the text. 


18. 
19. 


20. 


On the interval [0, c), solve y’ + ay = 0 with initial value y(0) = yo. 

On the interval [c, 00), solve y’+ay = 0 with initial value y(c)+k, where y(c) 
is the value of y(t) at t = c obtained from Exercise 18 for the interval [0, c]. 
Piece together the solutions obtained from Exercise 18 for the interval [0, c) and 
from Exercise 19 for the interval [c, oo) and verify that it is the same obtained 
from the formal Laplace transform method. 
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6.5 Convolution 


In this section, we extend to the Heaviside class the definition of convolution that 
we introduced in Sect. 2.8. The importance of convolution is that it is precisely the 
operation in input space that corresponds via the Laplace transform to the ordinary 
product in transform space. This is the essence of the convolution principle stated 
in Theorem 1 of Sect.2.8 and which will be proved here for the Heaviside class. 
We will then consider further extensions to the Dirac delta functions 6, and explore 
some very pleasant properties. 
Given two functions f and g in H, the function 


ut> f(u)g(t —u) 


is continuous except for perhaps finitely many points on each interval of the form 
[0, t]. Therefore, the integral 


t 
[ foe wou 
0 
exists for each t > 0. The convolution of f and g is given by 


fxet)= | felt —u) du. 
| 


We will not make the argument but it can be shown that f * g is in fact continuous. 
Since there are numbers K, L, a, and b such that 


|f(| < Ke" and |g(t)| < Le”, 


it follows that 


A 


If * el < [iro lg(t —w)| du 
0 


t 
KL / ete —4 dy 
0 


A 


t 


= KLe” / elt)! dy 


te”! if a=b 
ea ifa xb 
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et —ebt 


This shows that f * g is of exponential type since both te’ and [ap are 
exponential polynomials. It follows now that f * g € H. 

Several important properties we listed in Sect. 2.5 extend to H. For convenience, 
we restate them here: Suppose f, g, and / are in H. Then 


-Pfthxgafegtheg 

. (cf) *g=c(f * g), forc a scalar 
ef tee ae 

-(f *g)eh= f(g *h) 

. f *0=0. 


nABWN Re 


The Sliding Window 


When one of the functions, g say, is an on-off switch, then convolution takes a 
particularly simple form. Suppose g = Yja,). Then g(t) = 1 if and only ifa < 
t < b. Hence, g(t — u) = 1 if and only if a < t —u < b which is equivalent to 
t—b <u <t-—a. Thus, g(t —u) = y@—ss—a)(u) is an on-off switch on the interval 
(t — b,t — a] which slides to the right as ¢ increases. It follows that 


feet) = i OY Ce OL 
0 


One can think of g(t — u) as a horizontally sliding window by which a portion of f 
is turned on. That portion is then measured by integration. To illustrate this, consider 
the following example. 


Example 1. Let f(t) = (¢ — 3)h(¢ — 3) and g(t) = yj1,2)(¢). Find the convolution 
fee 

> Solution. In this case, g(t — uv) = Xp.2)(¢ —u) = ZXu-24-1)W). If t < 4, then 
t—2<t—1<3so g(t —u) turns on that part of f which is 0. Thus, 


fxget)=0, if0<t <4, 


as illustrated in Fig. 6.18. 
If4<t <5,thent—2 <3 <+-—1.Thus, g(¢ —w) turns of that part of f which 
is 0 on the interval (t — 2,3) and which is u — 3 on the interval [3, ¢ — 1). Thus, 


t—1 t-1 
feet)= | fdu= | u—3du 
ae 


t-1 


(u—3)° 
2 


-(=4)/ 
, 2 


, 4<t <5. 


This is illustrated in Fig. 6.19. 
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Now whent > 5, then 3 < t—2. Thus, g(t —u) turns on that portion of f which 
is u — 3 on the interval (¢ — 2,¢ — 1] and 
t-1 
fxg) = f (w-3)du 
1-2 


(u — 3)° 
2 


t—l 


_ 24-9 
t—2 2 


, 5<t<m. 


This is illustrated in Fig. 6.20. Finally, we piece together the convolution to get 


0 if O<1<4 
fees, HAcies (1) 
21-9 


3 if 5<t<o 


The graph of f * g is given in Fig. 6.21. < 


Theorem 2 (The Convolution Theorem). Suppose f and g are in. and F and 
G are their Laplace transforms, respectively. Then 


Lif * g}(s) = F(s)G(s) 


or, equivalently, 
Lo {F(s)G(s)} (t) = (f * g)(t). 


Proof. For any f € H, we will define f(t) = 0 fort < 0. By Theorem 8 of 
Sect. 6.2, 
e “G(s) =L{g(u—th(u—-t)}. 


Therefore, 


oe) 


F(s)G(s) = fevroa G(s) 
0 


CO 


= [era soa 


0 


= J ets t)h(u— t)} (8) f(t) dt 


ee 


=ff e ““g(u—t)h(u—t) f(t) dudt. (2) 
0 
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Fig. 6.18 When? — 1 < 3, 
the on-off switch y¢—2+—1] 
turns on that portion of f that 
is zero. Hence, f * g(t) = 0 
for all 0 < t < 4. Notice how 
the on-off switch slides to the 
right as f increases in the 
following figures 


Fig. 6.19 When 4 <?r <5, 
thent —2 <3 <t—1and 
the on-off switch y¢—24—1] 
turns on that portion of f that 
is zero to the left of 3 and the 
line u — 3 to the right of 3. 
Hence, f * g(t) = 

l= 3) du = * for 
4<t<5 


Fig. 6.20 When 5 < f, then 
3<t—2<t-—J1and the 
on-off switch 7 (;—2;—1) turns 
on that portion of f that is the 
line u— 3. Hence, f * g(t) = 
ae (u — 3) du = 28 for 
5<t<o 


Fig. 6.21 The graph of the 
convolution f * g(t) = 


0 if0<1<4 
(ow fact <5 
219 


5 if5<t<o 


< 


< 
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t—23 t-1 
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A theorem in calculus! tells us that we can switch the order of integration in (2) 
when f and g are in H. Thus, we obtain 


F(s)G(s) = [ feu -piu-p fener du 
0 


u 


0 
=f [memories 


0 
= fms «sy au 
0 
LA, 0 


There are a variety of uses for the convolution theorem. For one, it is sometimes 
a convenient way to compute the convolution of two functions f and g using the 
formula (f * g)(t) = L7!{F(s)G(s)}. In the following example, we rework 
Example | in this way. 


Example 3. Compute the convolution f * g where 


f(t) = (t—3)h@—3) and g(t) = xp.2- 


> Solution. The Laplace transforms of f and g are, respectively, 


e 3s e e725 
F(s) = —~ and G(s)= - 
Ss s 
The product simplifies to 
eo 4s es 
F()GG) = —- = 
Ss? Ss? 


Its inverse Laplace transform is 


(f * g(t) = L* {F(s)G(s)} (0) 


_ @-4) G3) 
= 5 h(t —4)— . 


h(t — 5) 


lef. Vector Calculus, Linear Algebra, and Differential Forms, J.H. Hubbard and B.B Hubbard, 
page 444. 
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0 if O<1<4 
= {oN if4er<5 . < 
wif 5<t<oco 


Convolution and the Dirac Delta Function 


We would like to extend the definition of convolution to include the Dirac delta 
functions 6,, c > 0. Recall that we formally defined the Dirac delta function by 


S(t) = lim dec(t), 
where d.g = 1 Xic.cte)- In like manner, for f € H, we define 
f # 8e(t) = lim f * dec(0). 
Theorem 4. For f € H, 


f * b(t) = f(t —c)h(t —c), 


where the equality is understood to mean essentially equal. 


Proof. Let f € H. Then 


fx dec(t) = f flddec(t wa 
0 


1 t 
= | faces — wa 
0 


I t 
2 / SW) xXtr—-c—e1—c) (u) du 
0 


Now suppose t < c. Then yy—c—es—c) (u) = 0, for all u € [0,¢). Thus, f * do. = 0. 
On the other hand, if ¢ > c, then for € small enough, we have 


€ 
i=¢ 


1 t—c 
frdact)=> f fluyau 
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Let ¢ be such that t — c is a point of continuity of f. Then by the fundamental 
theorem of calculus 


O€ 


i=e 
1 
lim — | flu) du = f(t —c). 
t—c—e€ 
Since f has only finitely many jump discontinuities on any finite interval, it follows 
that f * 6. is essentially equal to f(t —c)h(t —c). Oo 
The special case c = 0 produces the following pleasant corollary. 


Corollary 5. For f € H, we have 


fxbo =f 


This corollary tells us that this extension to the Dirac delta function gives an 
identity under the convolution product. We thus have a correspondence between 
the multiplicative identities in input space and transform space under the Laplace 
transform since £ {59} = 1. 


Remark 6. Notice that when f(t) = 1, in Theorem 4, we get 
1*}6.=h(t—c). 


This can be reexpressed as 


[sco du = h(t —c). 
0 


Thus, the integral of the Dirac delta function is the unit step function shifted by c. 
Put another way, the derivative of the unit step function, h(t — c), is the Dirac delta 
function, 6,. 


The Impulse Response Function 


Suppose q(s) is a polynomial of degree n. The solution ¢(t) to the initial value 
problem 


q(D)y = 8) y(0) =0, y'0) =0,...,y"- 20) = 0, (3) 


is called the unit impulse response function. In the case where deg q(s) = 2, the 
unit impulse response function may be viewed as the response to a mass-spring 
dashpot system initially at rest but hit with a hammer of impulse | at tf = 0 as 
represented by the Dirac delta function 69. Applying the Laplace transform to (3), 
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we get Y(s) = an and thus the unit impulse response function is given by the 
Laplace inversion formula 
1 
b= £ — : 
q(s) 


Let f € H (or f could be a Dirac delta function) and let us consider the general 
differential equation 


q(D)y =f. y(0) = yo. yO) = yi, YO) = Yn. (4) 
Let F(s) = £L{f(t)}. Applying the Laplace transform to both sides gives 
q(s)¥(s) — p(s) = F(s), 


where p(s) is a polynomial that depends on the initial conditions and has degree at 
most n — 1. Solving for Y(s) gives 


p(s) | F(s) 
Y(s) = —— + —. 5 
. q(s) : q(s) =e 
= (s) F(s) 
= PAS) = PAS? 
Yn(s) = a) and Y,(s) rol 


If yn(t) = £7! {¥n(s)}, then yp, is the homogeneous solution to (4). Specifically, yp 
is the solution to (4) when f = 0 but with the same initial conditions. We sometimes 
refer to yp, as the zero-input solution. 

On the other hand, let y,(t) = 27! {¥p(s)}. Then yy is the solution to (4) when 
all the initial conditions are zero, sometimes referred to as the zero-state. We refer 
to yp as the zero-state solution. Since Y(s) = aa (s), we get by the convolution 
theorem 


p(t) = 6 * f(t). (6) 


This tells us that the solution to a system in the zero-state is completely determined 
by convolution of the input function with the unit impulse response function. 
We summarize this discussion in the following theorem: 


Theorem 7. Let f € H (ora linear combination of Dirac delta functions). The 
solution to (4) can be expressed as 


Yh + Yp> 


where yp is the zero-input solution, that is, the homogeneous solution to (4) (with 
the same initial conditions), and yp = € * f is the zero-state solution given by 
convolution of the unit impulse response function € and the input function f. 
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Remark 8. In Exercises 15-21, we outline a proof that the homogeneous solution 
yp can be expressed as a linear combination of 


fC, ST cam 


and provide formulas for the coefficients in terms of the initial conditions. The 
reader is encouraged to explore these exercises. It follows then that both yp, and 
Yp are directly determined by the unit impulse response function, ¢. 


As an example of the techniques we have developed in this section, consider the 
differential equation that solved the mixing problem given in Example | of Sect. 6.4. 


Example 9. Solve the following differential equation: 


1 
‘4 —y = 36 0) = 20. 
a Tes 5 y(0) 


> Solution. The characteristic polynomial is g(s) = s + 1/10, and therefore, the 
unit impulse response function is €(t) = £7! |i} = e !/1% The zero-state 


solution is yp = € * 355 = 3e-“~9)/!A(¢ — 5) by Theorem 4. It is straightforward 
to see that the homogeneous solution is y, = 20e7!/!°". We thus get 


y(t) = 2008/9 4 30/9 yt — 5) 


_ 20e-1/10 if 0<t<5S, 
20e7/19 4. Ze “S/O if 5 < tt <0. 


Example 10. Solve the following differential equation: 
y” +4y = xp. yO) = 0 and y’(0) = 0. 
> Solution. The homogeneous solution to 
y’+4y=0 y(0) =Oand y'(0) =0 
is the trivial solution y, = 0. The unit impulse response function is 


1 
se +4 


e@=c = 5 sin2. 


By Theorem 7, the solution is 


y(t) = 6 * Xp 


t 


1 
— ; 5 sin(2u) X(0,1) (¢ _ u) du 
0 
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t 


| sin(2u) x ¢—1,1](u) du 


0 


1 
2 


t 
fsin2udu if O<t<1 
fsin2udu if 1<t<oo 
t—1 


— 


“moe if 0<t<1 
= < 


cos2(t—1)—cos2t if 1<t<oco 


In the following, we revisit Example 4 of Sect. 6.4. 


Example 11. Solve the differential equation 
y” + 20y = 63, y(0)=0.1, y’/(0) =9, 


that models the spring problem given in Exercise 4 of Sect. 6.4. 


> Solution. The characteristic polynomial is g(s) = s? +20. So the homogeneous 
solution is yy = cy cos ¥ 20f + c2 sin ¥20t. The initial conditions easily imply that 


a= a and cz = 0. So yp = a cos /20t. The unit impulse response function is 


1 1 
c(t) = £7! ar | =H sin V208. 


It follows from Theorem 4 and 7 that 
Yp(t) = ¢ * d3(t) 

1 
/ 20 


It follows now that the solution to the spring problem in Example 4 of Sect. 6.4 is 


(sin V20(t — 3))h(t — 3). 


II 


y(t) = = cos (v201) # =i (v20(1 = 3)) h(t —3) 


0 if 0<t <3, 


sey sin (/20(¢ — 3)) if3<t<0. « 


II 


a (v20r) + 
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Exercises 


1-8. Find the convolution of the following pairs of functions. 


| f(t) =e! and g) = x.y) 

f(t) = sint and g(t) = h(t — 2) 

. f(t) = th(t — 1) and g(t) = xp4 
f(t) =t and g(t) = (t — IA(t — 1) 
f(t) = X02) and g(t) = X02) 

S(t) = cost and g(t) = 2/2 

f(t) = sint and g(t) = 69 + 6, 

. f(t) = te” and g(t) = 6; — &) 


SNIDAARWN > 


9-14. Find the unit impulse response function ¢ and use Theorem 7 to solve the 
following differential equations. 


9. y —3y =A(t—2), y(0)=2 

10. y’' +4y =63, y(O)=1 

11. y'+ 8y = xp,5), y(0) =—2 

12. y”—y = 6i(t) —82(t), yO) =0, y’(0) =0 
13. y” + 9y = x22), y(0) = 1, y'(0) = 0. 

14. y’—6y’ + 9V = 83, y(0)=—1, y'(0) = —3 


15-21. Suppose g(s) = ays" +ay,_18"~!+---+a,s+ao, dy # 0. In these exercises, 
we explore properties of the unit impulse response function ¢ for q(D)y = do. 


15. Show that ¢ is the solution to the homogeneous differential equation 


q(D)y =0 
with initial conditions 
y(0) =0 
y'(0) =0 
y0) = 0 


y*(0) = 1/ap. 


16. Show that £ {¢} = x, 0 <k <n, andhence 6“ € &;. 


17. Show that {€, ¢/,...,¢~)} is a linearly independent subset of E,. 


450 6 Discontinuous Functions and the Laplace Transform 


18. Show that {¢, ¢/,...,¢@—)} spans E,. 
19. Show that {, ¢/,...,¢7)} is a basis of Ey. 
20. Show that the Wronskian of ¢, ¢’,...,¢~!) is given by the following formula: 


(-1) Lo ae t 
a" , 


WE Cys) = 


where |x| is the largest integer less than or equal to x. 


21. Let y be the solution to g(D)y = 0 with initial conditions 


y(0) = yo 
yO=zHyn 


y" YO) = Yn-1- 


Since y € €,, we may write 
_— / (n—1) 
YH oo talg +--+ aat” ”. 


Show that 
n—l—1 
cl = > Ak+I+1Vk- 
k=0 


22-26. Use the result of Exercise 21 to find the homogeneous solution to each of 
the following differential equations. It may be helpful to organize the computation 
of the coefficients in the following way: Let 0 < / <n — 1 and write 


ao A, +++ A] Aj+1 4j42°°° an 
Yo V1 tt+ Vn—-l-1 st Vn 
Co Cy ees C] eee 


In the first row, put the coefficients of g(s) starting with the constant coefficient 
on the left. In the second row, put the initial conditions with yo under a)+1, 1 
under a)+2, etc. Multiply terms that overlap in the first two rows and add. Put the 
result in c;. Now shift the second row of initial conditions to the right one place and 
repeat to get c;+,. Repeating this will give all the coefficients co,...,c,—1 needed 


iny = rrp ee. 


6.5 


22, 
23); 
24. 
25; 
26. 
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y"+9y =0, y(0)=1, y’'(0) =2 

y"—2y’+y=0, y(0)=2, y’(0) =—3 

y" +4y'+3y=0, y(0)=—-1, y’O)=1 

y"+y'=0, y(0)=1, y’(0)=0, y”(0) =4 

q(D)y = 0 where g(s) = (s — 1)* and y(0) = 0, y’(0) = 1, y”(0) = 0, and 
y”"(0) = -1 
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6.6 Periodic Functions 


In modeling mechanical and other systems, it frequently happens that the forcing 
function repeats over time. Periodic functions best model such repetition. 

A function f defined on [0, oo) is said to be periodic if there is a positive number 
p such that f(t + p) = f(t) for all ¢ in the domain of f. We say p is a period of 
f.If p > Ois a period of f and there is no smaller period, then we say p is the 
fundamental period of f although we will usually just say the period. The interval 
[0, p) is called the fundamental interval. If there is no such smallest positive p for a 
periodic function, then the period is defined to be 0. The constant function f(t) = 1 
is an example of a periodic function with period 0. The sine function is periodic 
with period 27: sin(t + 27) = sin(t). Knowing the sine on the interval [0, 277) 
implies knowledge of the function everywhere. Similarly, if we know /f is periodic 
with period p > 0 and we know the function on the fundamental interval, then we 
know the function everywhere. Figure 6.22 illustrates this point. 


The Sawtooth Function 


A particularly useful periodic function is the sawtooth function. With it, we may 
express other periodic functions simply by composition. Let p > 0. The saw tooth 
function is given by 


t if O0<t<p 
t—p if p<xt<2p 
t—2p if 2p<t<3p 


Pp 2p 3p 4p 5p 


Fig. 6.22 An example of a periodic function with period p. Notice how the interval [0, p) 
determines the function everywhere 
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LLLLE, 


Fig. 6.23 The sawtooth 
function (rt), with period p 


Fig. 6.24 The rectified sine 
wave: sin((t),,) 


Tv 27 37 An 57 


It is periodic with period p. Its graph is given in Fig. 6.23. The sawtooth function 
(t) p is obtained by extending the function y = ¢ on the interval [0, p) periodically 
to [0, oo). More generally, given a function f defined on the interval [0, p), then the 
composition of f and (ft), is the periodic extension of f to [0, 00). It is given by 
the formula 

F(t) if O0O<t<p 

f@-—p) if pst <2p 

F(t) p) = 
ft-2p) if 2p<t<3p 


In applications, it is useful to rewrite this piecewise function as 
CO 
~ Ft _ NP) Xtnpdnti)p)(t). 
n=0 


For example, Fig. 6.24 is the graph of y = sin((t),). This function, which is 
periodic with period z, is known as the rectified sine wave. 


The Staircase Function 


Another function that will be particularly useful is the staircase function. For p > 
O, it is defined as follows: 


0 if te [0,p) 


Pp if t € [p,2p) 


t|, = : 
lp 2p if t € [2p,3p) 


Its graph is given in Fig. 6.25. 
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Fig. 6.25 The staircase y 
function: [¢] 

4p + 

3p T 

2p + 

pk 

Pp 2p 3p 4p 5p 

Fig. 6.26 The graph of y 


1—e~ and 1 —e Ms 


The staircase function is not periodic. It is useful in expressing piecewise 
functions that are like steps on intervals of length p. For example, if f is a function 
on [0, 00), then f((*],) is a function whose value on [np, (n + 1)p) is the constant 
f (mp). Thus, 


f([tlp) = > FMP) Xinp.ntp)()- 


n=0 


Figure 6.26 illustrates this idea with the function f(t) = 1—e~ and p = 0.5. 
Observe that the staircase function and the sawtooth function are related by 


<t>p=t—[t]p. 


The Laplace Transform of Periodic Functions 


Not surprisingly, the formula for the Laplace transform of a periodic function is 
determined by the fundamental interval. 


Theorem 1. Let f be a periodic function in H and p > 0a period of f. Then 


P 


Lif}) = fe“ four. 


0 
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c 2c 3c Ac 5e 6c 


Fig. 6.27 The graph of the square-wave function sw, 


Proof. 


co 


Li fy) = fe“ feat 


0 


Dp lee) 
= fevroa + fe"ro dt. 
0 Pp 


However, the change of variables t — t+ p in the second integral and the periodicity 
of f gives 


fevroa = [ows + p)dt 
P 0 
— e °? e f(t) dt 
| 


=e ?PLif}(s). 


Therefore, 
77] 


LIfe) = fe fdr +ePL INO). 
0 
Solving for £ { f} gives the desired result. 


Example 2. Find the Laplace transform of the square-wave function sw, given by 


oO 


1 if t € 2nc, (2n + I)c) 
0 if te [Q2n+4+ Ic, (2n + 2)c) 


for each integer 7. 


sw, (t) = | 


> Solution. The square-wave function sw, is periodic with period 2c. Its graph is 
given in Fig. 6.27 and, by Theorem 1, its Laplace transform is 
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2c 
£ {swe} (9) = 5 =a f° go (t) a 
— e-2es 
— St 
= = dt 
0 
_ 1 L=e-"* 
~~ 1= (e7¢5)? Ss 
1 
~ Les 5° Bs 


Example 3. Find the Laplace transform of the sawtooth function < t >>. 


> Solution. Since the sawtooth function is periodic with period p and since 
<t>p)=tfor0<t < p, Theorem | gives 


£{(0}p} (8) = a f era. 


Integration by parts gives 


P rr 1 P 
te” 
fevre = lo - = few dt 
—s —s 
0 0 
ee hen ee 
_ 0 


As mentioned above, it frequently happens that we build periodic functions by 
restricting a given function f to the interval [0, p) and then extending it to be 
periodic with period p: f((t),). Suppose now that f € 7. We can then express the 
Laplace transform of f((t) ,) in terms of the Laplace transform of f. The following 
corollary expresses this relationship and simplifies unnecessary calculations like the 
integration by parts that we did in the previous example. 
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Corollary 4. Let p > 0. Suppose f € H. Then 


1 
l—e 


Lif ((t)p)} () = Lif (t)— FACE — p)}. 


Proof. The function f(t) — f(t)hA(t — p) = f(t) — A(t — p)) is the same as f 
on the interval [0, p) and 0 on the interval [p, co). Therefore, 


p oo 


fevroa = fervo — FO)AE— pdt = LI f(t) — fA — p)}. 
0 


0 


The result now follows from Theorem 1. oO 


Let us return to the sawtooth function in Example 3 and see how Corollary 4 
simplifies the calculation of its Laplace transform. 


Lie) p} (s) 


II 


Lit —th(t — p)} 


l-—e-?P 


a : ae 
1—e-? (3s "cu pi) 


II 


The last line requires a few algebraic steps. 


Example 5. Find the Laplace transform of the rectified sine wave 


sin((t) 7). 
See Fig. 6.24. 


> Solution. Corollary 4 gives 


II 


1 
—— £{sint —sint h(t —2)} 
e Us 


Lsin((t)«)} = 


1 1 —ms : 
l—e-7™s (= 1 ~e £ sit + 2)}) 


1 (tte 
l—ev™ \ s241 J? 


where we use the fact that sin(t + 2) = —sin(t). < 
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Periodic Extensions of the Dirac Delta Function 


We will also consider in the applications inputs that are periodic extensions of the 
Dirac delta function. For example, 


8c ((t) p) = be + Sctp + Setap + bce+3p + °° 


where 0 < c < p is the periodic extension of the Dirac delta function, 5.. An 
important case is when c = 0. Then do((f) p), is the periodic extension of 59 with 
period p and represents a unit impulse at each multiple of t = p. Another important 
example is 


(9 — by) ({t)2p) = 80 = bp + 5%p a 53p ees 
the periodic extension of 59 — 5, with period 2p which represents a unit impulse at 
each even multiple of p and a negative unit impulse at odd multiples of p. 


Proposition 6. The Laplace transforms of 5o((t) p) and (69 — 5p)({t)2p) are given 
by the following formulas: 


1 
£AS0((t) p)} = 7p 
£ {(0 — 8p)((t)2p)} = — 


Proof. Let r be a fixed real or complex number. Recall that the geometric series 


lo) 
Yorral+rtg Ptr +-- 


n=0 
converges to + when |r| < 1. We can now compute the Laplace transforms. 


L {50((t) p)} =1+ e ?’ + e 2Ps + e PS See 


very 
n=0 


1 
l—e Ps" 
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Similarly, 


L {(60 — 5p) (({t)2p)} = 1-8 4 e728 PS 


¥ (=e-78)" 


n=0 
1 
~ | fers’ 


II 


The Inverse Laplace Transform 
The inverse Laplace transform of functions of the form 


——_F 
l-—e (s) 


is not always a straightforward matter to find unless, of course, F'(s) is of the form 
Lif (t) — f()h(t — p)} so that Corollary 4 can be used. Usually, though, this is 
not the case. Since 


we can write 


pF) = ye FG). 


n=0 


1- 


If f = £7! {F}, then a termwise computation gives 


CO 


1 lo) 
co oer = S°L7 fe" F(s)} = J fle —npyht = np). 


n=0 n=0 


For ¢ in an interval of the form [Vp,(N + 1)p), the function h(t — np) is 1 for 
n=0,...,N and 0 otherwise. We thus obtain 


7 l loo) N 
a ew Fr| = > (>: f(t -n) XINdAN+)p)+ 
N=0 \n=0 
A similar argument gives 
1 lo) N 
ae ero a x (Dense 7) XINDAN+1)p)- 
N=0 \n=0 


For reference, we record these results in the following theorem: 
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Theorem 7. Let p > 0 and suppose L{f(t)} = F(s). Then 
Leo =e F(s)} = Vv=0 ba iG= np)) XINp(N+1)p)- 


2. £7 {izes F(s)} = Vv=0 (Smo FE —np)) XINpAN+1)p)- 
Example 8. Find the inverse Laplace transform of 


1 
(a _ e725) . 


> Solution. If f(t) = 1, then F(s) = + is its Laplace transform. We thus have 


S 


1 fore) N 
co! tase = > (> ft 2») XRN2UN+)) 


N=0 \n=0 
co 


> (N + l)xpn2w+1) 
N=0 


II 


II 


1 lo. e) 
1+ 2N 
+ 5 y X2N.2(N +1)) 


II 


142i 
alte. < 


Remark 9. Generally, it will not be possible to express the final answer in a nice 
closed form as in Example 8; one may have to settle for an infinite sum as given in 
Theorem 7. 
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Exercises 


1-5. Reexpress each sum in terms of the sawtooth function (t) , and/or the staircase 
function [f],. (Since tf — (t)» = [t],, there are more than one equivalent answer.) 


Le Pot =F) teeny © 
2. pe: = 1)? Xpn.2(n+1)) (t) 
3. ro 2? Xn aint) (t) 

4. Sg Ot Xan ain) (6) 


5. o(t +2) Xpn2040) (0) 


6-10. Find the Laplace transform of each periodic function. 


6. f((t)2) where f(t) = t? 
7. f((t)3) where f(t) = e' 


t if 0<t<1l 


8. f((t)2) where f(t) = i, if l<t<2 


9. f((t)2p) where f(t) = " : O<t<p 
—l if p<xt<2p 
10. S(t) x) where F(t) = cost 


11-14. Find the Laplace transform of f([t],), where [t], is the staircase function. 


11. f([t]») where f(t) = ¢. That is, find the Laplace transform of the staircase 
function [f]. 


12. f(t]1) where f(t) =e’ 
13. f({t]2) where f(t) =e 
14. f([t]s) where f(t) = 17. Hint: Use the fact that °° )n?x” = wey for 


lee) ed, 


15. Suppose f € H. Show that 


—ps © 


LUF (tp) = —— fore. 


n=0 
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16-18. Find the inverse Laplace transform of each function. 


—2s 


16: 
* s(1—e7*5) 
1= e 4(s—2) 
1G, eo 
(1 — e~*5)(s — 2) 
18 ! 
" (haer4y(9 = 2) 
le if t € [Np,(N + 1)p), (N even) 
LUFF} =e% 
er sift € [Np,(N + 1)p), (N odd) 
[t]p 
1+ (-1)? etlle +P) 


=_— ew 


(Use the fact that 1 + x + x7 + 


1+e” 


1—xN +1 
1-x 


aeeck XX 


) 


20. In the text, we stated that the constant function | is periodic with period 0. Here 
is another example: Let Q denote the set of rational numbers. Let 


Xolt) 


1 
0 


ifteQ 
if r¢éQ. 


Show that y is periodic with period g for each positive gq € Q. Conclude that 


Xo has fundamental period 0. 
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6.7 First Order Equations with Periodic Input 


We now turn our attention to two examples of mixing problems with periodic input 
functions. Each example will be modeled by a first order differential equation of the 
form 


y' +ay = f(t), 
where f(t) is a periodic function. 


Example 1. Suppose a tank contains 10 gal of pure water. Two input sources 
alternately flow into the tank for 1-min intervals. The first input source begins 
flowing at ¢ = 0. It consists of a brine solution with concentration | 1b salt per 
gallon and flows (when on) at a rate of 5 gal/min. The second input source is pure 
water and flows (when on) at a rate of 5 gal/min. The tank has a drain with a constant 
outflow of 5 gal/min. Let y(t) denote the total amount of salt at time ¢. Find y(t) 
and for large values of t determine how y(rt) fluctuates. 


> Solution. The input rate of salt is given piecewise by the formula 


5 if 2n<t<2n+1) 


5swi(t) = ; 
O if 2n4+1<t<2n+2 


The output rate is given by 


This leads to the first order differential equation 
, 1 
y + 5y = Sswilt) y(0) = 0. 


A calculation using Example 2 of Sect. 6.6 shows that the Laplace transform is 


1 1 
I+e% s(s+ 4)’ 


Y(s) =5 


and a partial fraction decomposition of CES gives 


1 1 1 l 
— 10 
l+e 8 I+e% s+4 


Y(s) = 10 


Now apply the inverse Laplace transform. To simplify the calculations, let 


1 1 
Y,(s) = 10——_ -, 
i(s) l+e™ s 
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1 1 
Y. = 10——_ : 
2(s) 1+e-5 s+i 


Then Y(s) = Y,(s) — Y2(s). By Example 2 of Sect. 6.6, we have 
L7 {Yi (s)} = 10swi(t). 


By Theorem 7 of Sect. 6.6, the inverse Laplace transform of the second expression is 


co «€6UN 
£7" {¥o(s)} = 10 > Y(-1)"e 2 yey 


N=0n=0 


1\n 
—e€? ) XIN.N+1) 


| 
= 
S 
°| 
ne 
a 


ll 
a 
oS 
oO 
| 
NI 
el ai 


XIN.N+1) 


l+e2 if te[N,N +1) (Neven) 
l-e? if te [N,N +1) (Nodd) — 


II 


Finally, we put these two expression together to get our solution 


1 
10e~2’ }\1+e 2 if te [N,N +1) (Neven) 
y(t) re 10 sw, (t) — T N+1 : 
l+e2 (l-—e 2 if t € [N,N + 1) (N odd) 
ily =t+N+1 
e2+e 2 
10 — 10 -————_——___ if te [N,N + 1) (Neven) 
1+e2 
~ _l; —t+N+1 
é 2%—¢E 2 
—10——____—— if t ¢ [N, N + 1) (N odd) 
1+e2 


The graph of y(t), obtained with the help of a computer, is presented in Fig. 6.28. 
The solution is sandwiched in between a lower and upper curve. The lower curve, 
I(t), is obtained by setting t = m to be an even integer in the formula for the solution 
and then continuing it to all reals. We obtain 


e-m ra et! 
iio 6 


Nie 


—1mn 
=o qpesig 
1+e2 1+e2 
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Fig. 6.28 A mixing problem with square-wave input function 


and thus 
e7 2! +e2 
1+ e2 
In a similar way, the upper curve, u(f), is obtained by setting t = m7 to be slight 
smaller than an odd integer and continuing to all reals. We obtain 


I(t) = 10—10 


ie 19 


An easy calculation gives 


1 1 
limy—soo L(t) = 10 — 1% ~ 3.78 and lim;—.o9 u(t) = 1% ~ 6.22. 
1+e2 1+e2 
This means that the salt fluctuation in the tank varies between 3.78 and 6.22 lbs for 
large values of f. < 


In practice, it is not always possible to know the input function, f(t), precisely. 


Suppose though that it is known that f is periodic with period p. Then the total input 
on all intervals of the form [np, (n + 1) p) is hed f(t) dt = h, a constant. On the 
interval [0, p), we could model the input with a Dirac delta function concentrated at 
a point, c say, and then extend it periodically. We would then obtain a sum of Dirac 


delta functions of the form 
a(t) = h(8: + Se+p + Sc+2p +++) 


that may adequately represent the input for the system we are trying to model. 
Additional information may justify distributing the total input over two or more 
points in the interval and extend periodically. Whatever choices are made, the 
solution will need to be analyzed in the light of empirical data known about the 
system. Consider the example above. Suppose that it is known that the input is 
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periodic with period 2 and total input 5 on the fundamental interval. Suppose 
additionally that you are told that the distribution of the input of salt is on the first 
half of each interval. We might be led to try to model the input on [0, 2) by 350 + 35 1 
and then extend periodically to obtain 


a(t) = > yb. 


n=0 


Of course, the solution modeled by the input function a(t) will differ from the 
solution obtained using input function 5 sw, as given in Example 1. What is true 
though is that both exhibit similar long-term behavior. This can be observed in the 
following example. 


Example 2. Suppose a tank contains 10 gal of pure water. Pure water flows into the 
tank at a rate of 5 gal/min. The tank has a drain with a constant outflow of 5 gal/min. 
Suppose 3 Ibs of salt is put in the tank each minute whereupon it instantly and 
uniformly dissolves. Assume the level of fluid in the tank is always 10 gal. Let 
y(t) denote the total amount of salt at time ¢. Find y(t) and for large values of ¢ 
determine how y(t) fluctuates. 


> Solution. As discussed above, the input function is 3 yy bn, and therefore, 
the differential equation that models this system is 


VN] 


Haat nee 
n=1 


The Laplace transform leads to 


3 —SH 1 
Y(s) = 5s s —T 


and inverting the Laplace transform and using Theorem 7 of Sect. 6.6 give 


ie 
y(t) = 5 3t (> (!)} XIN.N-+1) 
0 


=-e 
N= n=0 
5 1 = al 1\2 
= ad 2 (> (c?) J awn 
N=0 \n=0 
N+1 
5 1wrl-e2 
— 2 
5) > — X(N.N+1) 
N=0 


% (e# = eet) 


2(1-e!) 
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Fig. 6.29 A mixing problem with a periodic Dirac delta function: The solution to the differential 
equation y’ + sy = > yan bn, y(0)=0 


The graph of this equation is given in Fig.6.29. The solution is sandwiched in 
between a lower and upper curve. The upper curve, u(t), is obtained by setting 
t = m to be an integer in the formula for the solution and then continuing it to all 
reals. We obtain 


and thus 


In a similar way, the upper curve, /(t), is obtained by setting ¢ = (m+ 1)~ (slightly 
less than the integer m + 1) and continuing to all reals. We obtain 


An easy calculation gives 


1 
—5e2 


lim;-+o0 u(t) = + X 6.35 and lim, +o 1(t) = —=, ~ 3.85. 
2(1-e4) 2(1-e4) 


This means that the salt fluctuation in the tank varies between 3.85 and 6.35 lbs for 
large values of f. < 
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A comparison of the solutions in these examples reveals similar long-term 
behavior in the fluctuation of the salt content in the tank. Remember though that each 
problem that is modeled must be weighed against hard empirical data to determine 
if the model is appropriate or not. Also, we could have modeled the instantaneous 
input by assuming the input was concentrated at a single point, rather than two 
points. The results are not as favorable. These other possibilities are explored in the 
exercises. 
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Exercises 


1-3. Solve the following mixing problems. 


1. Suppose a tank contains 10 gal of pure water. Two input sources alternately 
flow into the tank for 2-min intervals. The first input source begins flowing at 
t = 0. It is a brine solution with concentration 2 lbs salt per gallon and flows 
(when on) at a rate of 4 gal/min. The second input source is a brine solution with 
concentration 1 1b salt per gallon and flows (when on) at a rate of 4 gal/min. The 
tank has a drain with a constant outflow of 4 gal/min. Let y(t) denote the total 
amount of salt at time ¢. Find y(t) and for large values of t determine how y(t) 
fluctuates. 

2. Suppose a tank contains 10 gal of brine in which 20 lbs of salt are dissolved. 
Two input sources alternately flow into the tank for 1-min intervals. The first 
input source begins flowing at ¢ = 0. It is a brine solution with concentration 
1 Ib salt per gallon and flows (when on) at a rate of 2 gal/min. The second input 
source is a pure water and flows (when on) at a rate of 2 gal/min. The tank has a 
drain with a constant outflow of 2 gal/min. Let y(t) denote the total amount of 
salt at time f. Find y(t) and for large values of t determine how y(f) fluctuates. 

3. Suppose a tank contains 10 gal of pure water. Pure water flows into the tank at 
a rate of 5 gal/min. The tank has a drain with a constant outflow of 5 gal/min. 
Suppose 5 lbs of salt is put in the tank every other minute beginning at t = 0 
whereupon it instantly and uniformly dissolves. Assume the level of fluid in the 
tank is always 10 gal. Let y(t) denote the total amount of salt at time ¢. Find 
y(t) and for large values of t determine how y(t) fluctuates. 


4—5. Solve the following harvesting problems. 


4. In a certain area of the Louisiana swamp, a population of 2,500 alligators is 
observed. Given adequate amounts of food and space, their population will 
follow the Malthusian growth model. After 12 months, scientists observe that 
there are 3,000 alligators. Alarmed by their rapid growth, the Louisiana Wildlife 
and Fisheries institutes the following hunting policy for a specialized group of 
alligator hunters: Hunting is allowed in only an odd-numbered month, and the 
total number of alligators taken is limited to 80. Assuming the limit is attained 
in each month allowed and uniformly over the month, determine a model that 
gives the population of alligators. Solve that model. How many alligators are 
there at the beginning of the fifth year? (Assume a population of 3,000 alligators 
at the beginning of the initial year.) 

5. Assume the premise of Exercise 4, but instead of the stated hunting policy 
in odd-numbered months, assume that the Louisiana Wildlife and Fisheries 
contracts an elite force of Cajun alligator hunters to take out 40 alligators at the 
beginning of each month. (You may assume this is done instantly on the first 
day of each month.) Determine a model that gives the population of alligators. 
Solve that model. How many alligators are there at the beginning of the fifth 
year? 
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6.8 Undamped Motion with Periodic Input 


In Sect. 3.6, we discussed various kinds of motion of a spring-body-dashpot system 
modeled by the differential equation 


my” + py’ +ky = f(t). 


Undamped motion led to the differential equation 


my" +ky = f(t). (1) 
In particular, we explored the case where f(t) = Focoswt and were led to the 
solution 
Fran (cos wt — cos Br) if B Ao, 
yt) = (2) 
Fi F F _ 
Zot sin wt if B =a, 


where 6B = re . The case where f is close to but not equal to w gave rise to the 
notion of beats, while the case 8 = w gave us resonance. Since cos wt is periodic, 
the system that led to (1) is an example of undamped motion with periodic input. In 
this section, we will explore this phenomenon with two further examples: a square- 
wave periodic function, sw,, and a periodic impulse function, 5o((t)-) = eae One: 
Both examples are algebraically tedious, so you will be asked to fill in some of the 
algebraic details in the exercises. To simplify the notation, we will rewrite (1) as 


y" + By = g(t) 


and assume y(0) = y’(0) = 0. 


Undamped Motion with Square- Wave Forcing Function 


Example 1. A constant force of r units for c units of time is applied to a mass- 
spring system with no damping force that is initially at rest. The force is then 
released for c units of time. This on—off force is extended periodically to give a 
periodic forcing function with period 2c. Describe the motion of the mass. 


> Solution. The differential equation which describes this system is 


y’ + B’y =rsw(t), y(0) =0, yO) =0, (3) 
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where sw, is the square-wave function with period 2c and A? is the spring constant. 
By Example 2 of Sect. 6.6, the Laplace transform leads to the equation 


¥(s) 1 1 r 1 (- Ss ) 
Ss = r — = . 
1 + e7se s(s? + B?) p? 1 +e75¢ S g2 + p? 
r 1 1 r 1 Ky 


= — 7 4 
p2 lt+e<s p? 1+e-%¢ g2 + p? ( ) 
Let 1 i i 
r r s 
F\(s) = —=————- d Fy(s)= : 
166) Br le" s sie 24s) B? 1+ 7S s? + B? 
Then Y(s) = F\(s) — F(s). Again, by Example 2 of Sect. 6.6, we have 
r 
AO= gael (5) 
By Theorem 7 of Sect. 6.6, we have 
7 loo) N 
fl) = > (d-0" cos(Bt - no) AIWeW +e): (6) 
N=0 \n=0 
We consider two cases. 
Bc Is not an Odd Multiple of z 
Lemma 2. Suppose v is not an odd multiple of m and let a = Sor Then 
N 
1 Yo(- 0)" cos(u + nv) = : (cosu + a@ sin u) 
) n=0 7 
eal 
+ 5 (cos(u-+ Nv) —asin(u+ Nv)). 
a 1 
2; —1)" si = = (sinu— 
2! )" sin(u + nv) 5 (sin u — a cos(u)) 
I? a. 
+ 5 (sin(u + Nv) + acos(u+ Nyv)). 
Proof. The proof of the lemma is left as an exercise. Oo 
Let u = Bt andv = —fc. Thena = es. In this case, we can apply part 


(1) of the lemma to (6) to get 
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r CO 
At) = 3p Y— (cos Bt + asin Bt) Xpew +e 
N=0 


+397 Do CD™ (cos Ble — Ne) — asin BE — Ne)) xinesn +e 
N=0 


r : 
= 3g7 os Bt + asin Bt) 


rr eae (cos B(t), — asin B(t),). 


Let 
Vu) = By Swell) — sap(—D/" (Cos Bt)e —arsin Bi t)e) 
= 5gp (Z9welt) — (I (cosBlt)e —arsin Blt) 
and 
yo(t) = — za (eos Br + asin Bt). 
Then 
yt) = AM -— AW) = nO + y2@) 
= agp (29welt) — (Dl (cos Bit). — asin Bit) 
— 7p (Cos + asin Br). (7) 


A quick check shows that y; is periodic with period 2c and y2 is periodic with 
period 2, Clearly, y2 is continuous, and since the solution y(t) is continuous by 
Theorem 7 of Sect. 6.1, so is y,. The following lemma will help us determine when 
y is a periodic solution. 


Lemma 3. Suppose g, and gz are continuous periodic functions with periods 
Pi > Oand pz > 0, respectively. Then g, + 2 is periodic if and only if . is a 
rational number. 


Proof. If = = “ is rational, then np; = mp2 is acommon period of g; and g and 


hence is a period of g; + gp. It follows that g; + go is periodic. The opposite 
implication, namely, that the periodicity of gj + g2 implies as is rational, is a 


nontrivial fact. We do not include a proof. Oo 


Using this lemma, we can determine precisely when the solution y = y; + ya 
is periodic. Namely, y is periodic precisely when ra on B is rational. Consider 
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Fig. 6.30 The graph of (8) with c = an a periodic solution 


Fig. 6.31 The graph of (9): a nonperiodic solution 


the following illustrative example. Set r = 2,c = - and B = 1. Then <b = 3 is 


rational. Further, a, defined in Lemma 2, is 1 and 
y(t) = 2sw,(t) — (-1)"/' (cos(t), — sin(t).) — (cost + sint). (8) 


This function is graphed simultaneously with the forcing function in Fig. 6.30. The 
solution is periodic with period 4c = 67. Notice that there is an interval where 
the motion of the mass is stopped. This occurs in the interval [3c, 4c). The constant 
force applied on the interval [2c, 3c) gently stops the motion of the mass by the time 
t = 3c. Since the force is 0 on [3c, 4c), there is no movement. At t = 4c, the force 
is reapplied and the process thereafter repeats itself. This phenomenon occurs in all 
cases where the solution y is periodic. 

Now consider the following example that illustrates a nonperiodic solution. Set 
r =2,c = 5,and 8 = 1 in(7). Then 


y(t) = 2sws(t) — (—1)"/7l! (cos(t)5 — a sin(t)s) — cost — a sint, (9) 
where @ = —_— Further, B = 2 is irrational so y(t) is not periodic. This is 


clearly seen in the rather erratic motion given by the graph of y(¢) in Fig. 6.31. 
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-10 4 


Fig. 6.32 The graph of (8) with c = on the beats are evident here 


In Sect. 3.6, we observed that when the characteristic frequency of the spring 
is close to but not equal to the frequency of the forcing function, cos(wf), then 
one observes vibrations that exhibit a beat. This phenomenon likewise occurs for 
the square-wave forcing function. Letr = 2,c = x and 6 = 1. Recall that 
frequency is merely the reciprocal of the period so when these frequencies are close, 


so are their periods. The period of the spring is a = 2x while the period of the 


forcing function is 2c = mn their periods are close and likewise their frequencies. 
Figure 6.32 gives a graph of y in this case. Again it is evident that the motion of the 
mass stops on the last subinterval before the end of its period. More interesting is the 
fact that y oscillates with an amplitude that varies with time and produces “beats”’. 


Bc Is an Odd Multiple of z 


We now return to equation (6) in the case Bc is an odd multiple of 2. Things reduce 
substantially because cos(Bt — NBc) = (—1)% cos(Bt) and we get 


co «6N 
A(t) = zi Yo do cos(Bt) xivew +16) 


N=0n=0 


Co 
. 
7 p2 ye + 1) Xtwew+ te) Cos(Bt) 
N=0 


r 


= pillt/ehi + 1) cos(Br). 
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Fig. 6.33 The graph of (10) with r = 2, 8 = z, and c = 3: resonance is evident here 


The solution now is 


yt) = fi — f®) 


= zi (sw. (t) — [t/c]; cos(Bt) — cos(Br)) 


. 7. 1—(n+1)cos(Bt) if t € [cn,c(n + 1)), n even (10) 
— B? —(n + 1) cos(Br) if t € [cn,c(n + 1)), n odd. , 


The presence of the factor n + 1 implies that y(t) is unbounded. Figure 6.33 
gives the graph of this in the case where r = 2, 6B = a, andc = 3. Resonance 
becomes clearly evident. Of course, this is an idealized situation; the system would 
eventually fail. < 


Undamped Motion with Periodic Impulses 


Example 4. A mass-spring system with no damping force is acted upon at rest by 
an impulse force of r units at all multiples of c units of time starting att = 0. 
(Imagine a hammer exerting blows to the mass at regular intervals.) Describe the 
motion of the mass. 


> Solution. The differential equation that describes this system is given by 


y"+B’y=r> bre y(0)=0, yO) =0, 


n=0 


where, again, 6” is the spring constant. The Laplace transform gives 
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r = —ncs B 
Ys)= 5 ve Tae 
n=0 


By Theorem 7 of Sect. 6.6, 


co N 
r ; 
y= 2 > y= sin(Br — NBC) X(We(N +10): (11) 
N=0n=0 
Again we will consider two cases. < 
Bc Is not a Multiple of 2x 
Lemma 5. Suppose v is not a multiple of 21. Let y = ne ;- Then 


1, ys sin(u + nv) = 5 (sinu + ycosu + sin(u+ Nv) — ycos(u+ Nv)). 


2. y cos(u + nv) = s (cosu—ysinu+cos(u+ Nv) + ysin(u+ Nyv)). 


Let u = Bt andv = —fc. By the first part of Lemma 5, we get 


foe) 
r 
y(t) = op 5 (sin Bt + y cos Bt) X[We(w+1)c) 
N=0 


Co 
r E 
+38 » (sin B(t — Nc) — y cos B(t — Ne)) Xiwecn +10) 
N=0 
= 3g (in Be + y cos Br + sin Blt). — 7 cos Bt), (12) 
where y = a Lemma 3 implies that the solution will be periodic when 
oa] z= Be is rational. Consider the following example. Let r = 2, B = 1, and 


c= m Equation (12) becomes 
y(t) = sint + cost + sin(t). — cos(t). (13) 


and its graph is given in Fig.6.34. The period is 62% = 4c. Observe that on 
the interval [3c,4c), the motion of the mass is completely stopped. At t = 3c, 
the hammer strikes and imparts a velocity that stops the mass dead in its track. 
At t = 4c, the process begins to repeat itself. As in the previous example, this 
phenomenon occurs in all cases where the solution y is periodic, that is, when 


c — pe; : 
in — on '8 rational. 
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Fig. 6.34 The graph of (13): ¢c = az 


-1.54 


Fig. 6.35 The graph of (14): a nonperiodic solution 


Now consider the following example that illustrates a nonperiodic solution. Set 
r =2,c = 4,and 8 = 1 in(12). Then 


y(t) = sint — ycost + sin(t)4 — y cos(t)4, (14) 


where y = Te Further, = 2 is irrational so y(f) is not periodic. The graph 
of y(t) in is given Fig. 6.35. Observe that the impulses given every 4 units suddenly 
changes the direction of the motion in a most erratic way. 

When the period of the forcing function is close to that of the period of the spring, 
the beats in the solution can again be seen. For example, if c = 2 (27) a a ,pH1; 


andr = 2, then (12) becomes 


y(t) = sint — (v2+ 1) cost + sin(t ot (V2 + 1) cos(t (15) 


and Fig. 6.36 shows its graph. 
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Fig. 6.36 The graph of (15) with e = om A solution that demonstrates beats 


24 


25 


Fig. 6.37 The graph of (16) with r = 2,c = 27, and B = 4. Resonance is evident 


Bc Is a Multiple of 22 


In this case, (11) simplifies to 


y(t) = z (sin bt + [t/ch; sin Bt) (16) 
a 3" + 1)sinft t €[en,c(n+1)). (17) 


The presence of the factor n+ 1 implies that y(t) is unbounded; resonance is present. 
Figure 6.37 gives a graph of the solution when c = 27, B = 4, andr = 2. 
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Exercises 


1-6. For the parameters 6, r, and c given in each problem below, determine the 
solution y(t) to the differential equation 


y" + By =rswe(t), yO) =0, yO) =0, 


which models undamped motion with square-wave forcing function. Is the solution 
periodic or nonperiodic? Does it exhibit resonance? 


lr=4,c=1,p=vV2 
2.r=2,c=2n,p =1/x 
3.r=2,c=2,p=a7 
4.r=4,c=1,p=7/2 
5.r=2,c=1,p=a7 
6.r=3,c=52,p=1 


7-12. For the parameters 6, r and c given in each problem below determine the 
solution y(t) to the differential equation 


y" + B’y =r pan y(0) = 0, y’(0) => 0, 


n=0 


which models undamped motion with a periodic impulse function. Is the solution 
periodic or non periodic? Does it exhibit resonance? 


7.r=2,c=2,p=1 

8 r=1,c=2,B=7/4 
9 r=2,c=1,p=1 
10.r=2,c= V2,8B =2/2 
ll.r=2,c=27,pB=1 
12,.r=2,c=4,p=n 


13-16. Euler’s formula 


e!? = cos@ +i sind 
is very useful in establishing Lemmas 2 and 5. These exercises guide you through 
the verifications. 


sin 6 


. Use Euler’s formula 
l—cos 6 


13. Suppose 6 is not a multiple of 27. Let y = y(0) = 
to show that 


N 

1 
Y \cosnd a aU +cosN@+ysin NO), 
n=0 


N 
y sinné = : (sin NO + y(1—cos N@)). 


n=0 
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14. 


15. 


16. 
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int: Expan _ (e'”)" in two different ways and equate real and imaginar 
(Hint: Expand ml ; id diff ° re cal ; y 
parts, use the formula 1+ x +x7+---x" = xN+ILy 


=ay> and use the trigonometric 
sum and difference formulas.) 


Suppose 6 is not an odd multiple of 7. Let a = a(@) = "2. Show that 


1+cos 6° 
= 1 
YC)” cosné = 5 (1+ (-1)" (cos N@ — asin N@)), 
n=0 
= 1 
yon" sinn@ = 7 (—a + (-1)* (sin NO + acos NO@)). 
n=0 
Prove Lemma 5. Namely, suppose v is not a multiple of 27. Let y = a 
Then 


1. saan cos(u + nv) = 5 (cosu—ysinu+ cos(u+ Nv) + ysin(u+ Nv)). 
2. ~ s sin(u + nv) = 5 (sinu + ycosu + sin(u+ Nv) —ycos(u+ Nv)). 


Prove Lemma 2. Namely, suppose v is not an odd multiple of a and leta = 


sin(v) 
1+cos(v) * Then 


N 
1 
1. yep" cos(u + nv) = 5 (cosu + a@ sinu) 
n=0 
al 


ro 


(cos(u + Nv) —asin(u+ Nyv)). 


N 
2. yv(-1" sin(u + nv) = ; (sin u — a cos(u)) 
n=0 
elu 


3 


(sin(u + Nv) + acos(u+ Nv)). 
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485 


Laplace transforms and convolutions presented in Chap. 6 are summarized in Tables 


6.1-6.3. 


Table 6.1 Laplace transform rules 
£0) 


Second translation principle 

1. ft —c)h(t —c) 

Corollary to the second translation principle 
2. g(t)h(t —c) 


Periodic functions 


3. f(t), periodic with period p 


4. f((t)p) 
Staircase functions 
5. f(ltlp) 
. . 1 
Transforms involving ———— 
lite? 


co 60ON 
6. & AG — NP) Xwp(n+1)p) 
=0n=0 


co N 
7 YY YC)" fC — ap) x wow) 


N=0n=0 


F(s) 


e  F(s) 


e“L{g(t + c)}) 


| 
Toone fo Fat 


PELL — FORE py} 


1 e7%, 


l—e ? 


ey f(npye"?s 


Page 


405 


405 


455 


458 


463 


461 


461 
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Table 6.2 Laplace transforms 
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f(t) F(s) Page 
The Heaviside function 

1. A(t —c) : 404 

Ss 
The on-off switch 
eos es 

2. X{a,b) —— 3 405 
The Dirac delta function 

3. 8¢ eae 428 
The square-wave function 

1 1 
4. swe = 456 
Il+es 

The sawtooth function 

5.(t)p nee) 457 
Periodic Dirac delta functions 

6. So((t) p) — 459 
Alternating periodic Dirac delta functions 

7. (80 — 8p )((t)>p) a 459 
Table 6.3 Convolutions 
fO) g(t) (f * gs) Page 
1. f(0) g(t) f*sQ) = fo Swat —w du 439 
Dif 5¢(t) f(t — c)h(t — ce) 444 
3: F do(t) f(t) 445 


Chapter 7 
Power Series Methods 


Thus far in our study of linear differential equations, we have imposed severe 
restrictions on the coefficient functions in order to find solution methods. Two 
special classes of note are the constant coefficient and Cauchy—Euler differential 
equations. The Laplace transform method was also useful in solving some differ- 
ential equations where the coefficients were linear. Outside of special cases such 
as these, linear second order differential equations with variable coefficients can be 
very difficult to solve. 

In this chapter, we introduce the use of power series in solving differential 
equations. Here is the main idea. Suppose a second order differential equation 


ar(t)y” + ai(t)y’ +. ao(t)y = f(t) 


is given. Under the right conditions on the coefficient functions, a solution can be 
expressed in terms of a power series which takes the form 


y@) = dealt — 0)", 
n=0 


for some fixed fp. Substituting the power series into the differential equation gives 
relationships among the coefficients {c,}°°, which when solved gives a power 
series solution. This technique is called the power series method. While we may 
not enjoy a closed form solution, as in the special cases thus far considered, power 
series methods imposes the least restrictions on the coefficient functions. 


W.A. Adkins and M.G. Davidson, Ordinary Differential Equations, 487 
Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-3618-8_7, 
© Springer Science+Business Media New York 2012 
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7.1 A Review of Power Series 


We begin with a review of the main properties of power series that are usually 
learned in a first year calculus course. 


Definitions and Convergence 


A power series centered at to in the variable t is a series of the form 


[o.e) 
Yo ent = to)" = co + e1(t = fo) + a(t — to)? +++. (1) 
n=0 


The center of the power series is fo, and the coefficients are the constants {c,}02.9. 
Frequently, we will simply refer to (1) as a power series. Let I be the set of real 
numbers where the series converges. Obviously, fo is in J, so J is nonempty. It turns 
out that J is an interval and is called the interval of convergence. It contains an open 
interval of the form (t9 — R, to + R) and possibly one or both of the endpoints. The 
number R is called the radius of convergence and can frequently be determined by 
the ratio test. 


The Ratio Test for Power Series Let )--~.. Cn(t — to)" be a given power series and 
Cnh+1 
¢, 


n 


suppose L = limy-+90 


. Define R in the following way: 


Then 


1 The power series converges only at t = to if R = 0. 
2 The power series converges absolutely for allt € Rif R = oo. 


3 The power series converges absolutely when |t —to| < R and diverges when 
lt—to| > Rf0<R<o. 


If R = 0, then J is the degenerate interval [fo, fo], and if R = oo, then J = 
(—oo, co). If 0 < R < ow, then J is the interval (t) — R, ft) + R) and possibly the 
endpoints, fg — R and fo + R, which one must check separately using other tests of 
convergence. 

Recall that absolute convergence means that )~°~.9 |cn(t — to)” | converges and 
implies the original series converges. One of the important advantages absolute 
convergence gives us is that we can add up the terms in a series in any order we 
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please and still get the same result. For example, we can add all the even terms and 
then the odd terms separately. Thus, 


So en(t = to)” = Yo en(t = t0)" + Yo en(t — 0)" 


n=0 n odd n even 
love) lore) 
= , 2n+1 y 2. 
= Conti l(t = to) " ar Con (t a to) is 
n=0 n=0 


Example 1. Find the interval of convergence of the power series 
n2" ~ 
n=1 
> Solution. The ratio test gives 


n2" n 1 


~f@+D241~ 2@4+h 2 


Cn+1 
Cn 


as n — oo. The radius of convergence is 2. The interval of convergence has 4 as the 
center, and thus, the endpoints are 2 and 6. When t = 2, the power series reduces to 
Si cy , which is the alternating harmonic series and known to converge. When 
t = 6, the power series reduces to ber 1, which is the harmonic series and known 


to diverge. The interval of convergence is thus J = [2, 6). < 


Example 2. Find the interval of convergence of the power series 


[o,@) 
(—1)"1?" 
Jo(t) = Ee arene 
o(?) dX 2n (nl)? 
> Solution. Let vu = ¢?. We apply the ratio test to )°°° Goat to get 
Cn+1 Qn (n!) 1 
— = > 0 
Cn 22+) ((n + 1)!)2 4(n + 1)? 
as n — oo. It follows that R = oo and the series converges for all u. Hence, 
ear ee converges for all tf and J = (—ov, 00). < 


In each example, the power series defines a function on its interval of con- 
vergence. In Example 2, the function Jo(t) is known as the Bessel function of 
order 0 and plays an important role in many physical problems. More generally, 
let f(t) = se Cn(t — to)” for all t € 7. Then f is a function on the interval 
of convergence J, and (1) is its power series representation. A simple example 
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of a power series representation is a polynomial defined on R. In this case, the 
coefficients are all zero except for finitely many. Other well-known examples from 
calculus are: 


sad t” 12 3 
— —=14+t4+=-4+=+-:--, 2 
e ae ee ae (2) 
[o,@) 
(—1)"12" 2 t4 
t= =|[-—— Ee 3 
- Dy (Qn)! 2H @) 
(- Vie B iP 
— — eee, 4 
om = Qn+D! 3 5 oe 
1 CO 
2 
aos ea =14+t+P te, (5) 
LerD( n t—1)2 t—1) 
= OT eu! ~ ai = ated, (6) 


Equations (2), (3), and (4) are centered at 0 and have interval of convergence 
(—oo, co). Equation (5), known as the geometric series, is centered at 0 and has 
interval of convergence (—1, 1). Equation (6) is centered at 1 and has interval of 
convergence (0, 2]. 


Index Shifting 


In calculus, the variable x in a definite integral i f(x) dx is called a dummy 
variable because the value of the integral is independent of x. Sometimes it is 
convenient to change the variable. For example, if we replace x by x — 1 in the 
integral / i =a dx, we obtain 


2 
1 
x+1 
1 
In like manner, the index n in a power series is referred to as a dummy variable 
because the sum is independent of 7. It is also sometimes convenient to make a 


change of variable, which, for series, is called an index shift. For example, in the 
series )-°° ,(n + 1)t”*!, we replace n by n — | to obtain 


=2 3 


ee) = ae 1= f Lax, 


x-1=1 2. 


x 


n—1=o00 


[o.e) 
>t +1)"t! = ~ @=141)"°'"! = > a” 


n=0 n—1=0 n=1 
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The lower limit n = 0 is replaced by n — 1 = Oorn = 1. The upper limit n = oo 
is replace by n — 1 = o0 orn = oo. The terms (n + 1)t”*! in the series go to 
(n—1+ 10774! =nt". 

When a power series is given is such a way that the index n in the sum is the 
power of (f — %&), we say the power series is written in standard form. Thus, 
>-2 nt" is in standard form while )°°o 9(n + Lt"! is not. 


: : : n—2 , 
Example 3. Make an index shift so that the series )°°°., on is expressed as a 
series in standard form. 


> Solution. We replace n by n + 2 and get 


pr n+2=00 pnt2-2 


Le (n + 2)2 - ay < 


n+2=2 


Differentiation and Integration of Power Series 


If a function can be represented by a power series, then we can compute its derivative 
and integral by differentiating and integrating each term in the power series as noted 
in the following theorem. 


Theorem 4. Suppose 
Co 
f(t) = Yo ent = to)" 
n=0 


is defined by a power series with radius of convergence R > 0. Then f is 
differentiable and integrable on (to — R, t) + R) and 


f(t) = Yo neg(t = t0)"! (7) 
n=1 
and 
= fat -_ to)?! 
[ foa=y Rsk +C. (8) 


Furthermore, the radius of convergence for the power series representations of f’ 


and [ f are both R. 


We note that the presence of the factor n in f’(t) allows us to write 
Co 
f'O) = Di nen(t - to)" 
n=0 


since the term at n = 0 is zero. This observation is occasionally used. Consider the 
following examples. 
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Example 5. Find a power series representation for in standard form. 


il 
(—t)2 


> Solution. If f(t) = wo , then f’(t) = ——,. If follows from Theorem 4 that 
CO 
n n-1 _ n 
aap = -5>"- ea =)om+e. < 
n=1 n=0 


Example 6. Find the power series representation for In(1 — ¢) in standard form. 


> Solution. For ¢ € (—1, 1), n(l —1) = — f 4 + C. Thus, 


oO pit 


In(l—t) =C- foe dt =C— La ° “2a 


n=0 n= 


Evaluating both side at t = 0 gives C = 0. It follows that 


CO an 
nii=) >=) < 


n=1 
The Algebra of Power Series 


Suppose f(t) = yy an(t — to)” and g(t) = \-v2. by (t — to)” are power series 
representation of f and g and converge on the interval (f9 — R,t) + R) for some 
R > 0. Then 

F(t) = g(t) if and only if a, = b,, 


for alln = 1,2,3,.... Letc € R. Then the power series representation of f + g, 
cf, fg, and f/g are given by 


fO4EO= De + by)(t — to)", (9) 
cf(t) = 2s cAn(t — to)", (10) 
n=0 
f@®eg(t) = Sent —to)" where Cy = aoDy + aybn—| +++: + anbo, (11) 
n=0 
and fO = a (t—to)", g(a) #0, (12) 


gt) <> 
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where each d,, is determined by the equation f(t) = g(t) °°2o dn(t — to)”. In 


(9), (10), and (11), the series converges on the interval (t9—R, to +R). For division of 
power series, (12), the radius of convergence is positive but may not be as large as R. 


Example 7. Compute the power series representations of 


t =t t 


. e' —e?! 
cosht = za and sinht = 


> Solution. We write out the terms in each series, e’ and e~, and get 


2 3 4 


tage ee 
e= +t+ yl + 31 + al SS tae 
2 43 4 
—t — —y — eee 
eT oF ay al 
2 14 
Ve —t 
e+e =2 +25, +23) + 
bP 
te at = ss = eae 
e—e ie all tal 
It follows that 
iad pan oo pont 
cosht = —— and sinht = ———_.. < 
dX (2n)! dX (2n + 1)! 


Example 8. Let y(t) = )°>2.9 cnt”. Compute 
(1+ 0?)y" + 4ty’ + 2y 


as a power series. 


> Solution. We differentiate y twice to get 
Co Co 
y(t) = Sour and y"(t)= So enn(n =e, 
n=1 n=2 


In the following calculations, we shift indices as necessary to obtain series in 
standard form: 


fore) Co 
try” = Yo enn(n -—1)j" = cyn(n — 1)0", 


n=2 n=0 


[o.@) [o,@) 
y” Yo enn(n —1)"? = So cnga(n + 2)(n + 1)t”, 


n=2 n=0 
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lo e) [oe 
Aty’ = >> 4ennt” = > 4ennt", 


n=1 n=0 
lee) 

2y= y 2c,t" 
n=0 


Notice that the presence of the factors n and n — | in the first series allows us to 
write it with a starting point n = O instead of n = 2, similarly for the third series. 
Adding these results and simplifying gives 


Co 
(1+ 27)y” + 4ty’+2y= a ((Cnt2 + Cn)(n + 2)(n + 1))t". < 
n=0 
A function f is said to be an odd function if f(—t) = —f(t) and even if 


f(-t) = f(t). If f is odd and has a power series representation with center 0, 
then all coefficients of even powers of ¢ are zero. Similarly, if f is even, then all the 
coefficients of odd powers are zero. Thus, f has the following form: 


f(t) = ao + aot? + agt* + = 5 dont?" f -even, 
n=0 


[e.2) 
f(t) =ait +agt? +ast? +... = YS aon4it?"*! f -odd. 
n=0 
For example, the power series representations of cost and cosh? reflect that they 
are even, while those of sin¢ and sinh? reflect that they are odd functions. 


Example 9. Compute the first four nonzero terms in the power series representa- 
tion of 
sinh t 


tanht = ; 
cosht 


> Solution. Division of power series is generally complicated. To make things 
a little simpler, we observe that tanh? is an odd function. Thus, its power series 
expansion is of the form tanht = °°, don,4it?"t! and satisfies sinht = 
cosht 7° 4 don 4it?"*!. By Example 7, this means 


5! 2 4! 


_ di\ 4 a3 di\ 5 
“(ura{eed)?(aebeSen) 


reo aes , Z 
ee bt or hes | (dita dt dst” =) 
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We now equate coefficients to get the following sequence of equations: 


dq, =1 
dy 1 
Oty = 3 

d; a, 
oro hal al 
ds dz dy 1 


—l7 


Recursively solving these equations gives d; = 1, d3 = = ds = x, and d7 = 
The first four nonzero terms in the power series expansion for tanh ¢ is thus 


ls, 25 _ 14 


tanht =t— =1 edie ee 
- a a5 “355° 7 


Identifying Power Series 


315° 


Given a power series, with positive radius of convergence, it is sometimes possible 
to identify it with a known function. When we can do this, we will say that it is 
written in closed form. Usually, such identifications come by using a combination 
of differentiation, integration, or the algebraic properties of power series discussed 


above. Consider the following examples. 
Example 10. Write the power series 


ad p2n+l 


n! 
n=0 


in closed form. 


> Solution. Observe that we can factor out ¢ and associate the term f7 to get 


from (2). 


Example 11. Write the power series 


in closed form. 
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> Solution. Let z(t) = }°°°., n(—1)"1°". Then dividing both sides by ¢ gives 


co 


0 Yin 1)"t p2"- 1 


n=1 
Integration will now simplify the sum: 


[@a- fa iy da 


n=1 


ae i 


n=1 


yo)" 


: : 1) + 

— —_————_ — Cc 3 

2\1+4+?? 

where the last line is obtained from the geometric series by adding and subtracting 
the n = 0 term and c is a constant of integration. We now differentiate this equation 


to get 
zt) id 1 : 
t  2dt\l+r 


—t 
~ (14+ 22)?" 


t2" 


II 


It follows now that ; 
—f 


(1+ 1?)?” 
It is straightforward to check that the radius of convergence is | so we get the 
equality 


2(t) = 


a ve n,2n 
ne Sao 


on the interval (—1, 1). < 


Taylor Series 


Suppose f(t) = )°°2. 9 cn(t — to)", with positive radius of converge. Theorem 4 
implies that the derivatives, f “) exist for all = 0,1,.... Furthermore, it is easy 
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(n) ‘ . 
to check that f (ty) = n'e, and thus c, = Le) Therefore, if f is represented 
by a power series, then it must be that 


OO Fn) 
fo= >, ew — to)". (13) 


n=0 


This series is called the Taylor series of f centered at to. 

Now let us suppose that f is a function on some domain D and we wish to find a 
power series representation centered at fg € D. By what we have just argued, f will 
have to be given by its Taylor Series, which, of course, means that all higher order 
derivatives of f at ft) must exist. However, it can happen that the Taylor series may 
not converge to f on any interval containing fo (see Exercises 28-29 where such an 
example is considered). When (13) is valid on an open interval containing fo, we call 
f analytic at ty. The properties of power series listed above shows that the sum, 
difference, scalar multiple, and product of analytic functions is again analytic. The 
quotient of analytic functions is likewise analytic at points where the denominator 
is not zero. Derivatives and integrals of analytic functions are again analytic. 


Example 12. Verify that the Taylor series of sin ¢ centered at 0 is that givenin (4). 


> Solution. The first four derivatives of sint and their values at 0 are as follows: 


ordern sin™)(t) sin (0) 


n=0 sin t 0 
n=1 cost 1 
n=2  -—sint 0 
n= —cost —l 
n= sin t 0 


The sequence 0, 1,0, —1 thereafter repeats. Hence, the Taylor series of sin ¢ is 


2 


t t4 p oo pant 
O+1t+ a 


1 a — 
ea eS esr 


n=0 


a 
a ae 


asin (4). < 


Given a function f, it can sometimes be difficult to compute the Taylor series 
by computing f (to) for all n = 0,1,.... For example, compute the first 
few derivatives of tanht, considered in Example 9, to see how complicated the 
derivatives become. Additionally, determining whether the Taylor series converges 
to f requires some additional information, for example, the Taylor remainder 
theorem. We will not include this in our review. Rather we will stick to examples 
where we derive new power series representations from existing ones as we did in 
Examples 5-9. 
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Rational Functions 


A rational function is the quotient of two polynomials and is analytic at all points 
where the denominator is nonzero. Rational functions will arise in many examples. 
It will be convenient to know what the radius of convergence about a point fo. The 
following theorem allows us to determine this without going through the work of 
determining the power series. The proof is beyond the scope of this text. 


Theorem 13. Suppose mo is a quotient of two polynomials p and q. Suppose 
q(to) 4 0. Then the power series expansion for t about to has radius of convergence 


equal to the closest distance from to to the roots (including complex roots) of q. 


Example 14. Find the radius of convergence for each rational function about the 
given point. 


t = 
1. = about fo = 1 


2. so about tg = 2 
a 


3. +1 


about fo = 2 


> Solution. 

1. The only root of 4 — tf is 4. Its distance to t9 = | is 3. The radius of convergence 
is 3. 

2. The roots of 9—t? are 3 and —3. Their distances to tf) = 2 is 1 and 5, respectively. 


The radius of convergence is 1. 


3. The roots of t? + 1 are i and —i. Their distances to f9 = 2 are |2 —i| = \/5 and 
|2 + i| = V5. The radius of convergence is /5. < 
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7.1 A Review of Power Series 
Exercises 


1-9. Compute the radius of convergence for the given power series. 


1. 3 n2(t — 2)" 


n=0 

foe) t? 
2. — 

n=| 

oo (¢ — 1)" 
3. 

>> 2"n! 
4 > 3"(¢ — 3)" 
n=0 2+ 1 

ee) 
5. So nlt” 

n=0 
> (—1)"12" 
" & Qn+ 1! 


ore) (—1)"22"41 
n=0 (2n)! 


9 x nit” 
"4 1-3-5-++(2n + 1) 


10-16. Find the Taylor series for each function with center ft) = 0. 
1 


10. 
14+ f2 
1 


t—a 


e’ —1 


t 


14. 


15. tan7!¢ 


16. In(1 + £2) 
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17-20. Find the first four nonzero terms in the Taylor series with center 0 for each 
function. 

17. tant 

18. sect 

19. e! sint 

20. e! cost 


21-25. Find a closed form expression for each power series. 


S nn+l14n 
21. (te 


n=0 


lee) 
2), 3h 2 yn 


n=0 


[oe 
23. So(n+ Wr" 


n=0 


ore) pent 


24. > 


n=0 2n—1 


pent 


25. 2. On + Nan =1) 


ll 


26. Redo Exercises 19 and 20 in the following way. Recall Euler’s formula e!’ = 
cost + i sin¢ and write e’ cost and e’ sint as the real and imaginary parts of 


e’e!’ = e+)! expanded as a power series. 


27. Use the power series (with center 0) for the exponential function and expand 
both sides of the equation ee” = e@+)', What well-known formula arises 
when the coefficients of a are equated? 

28-29. A test similar to the ratio test is the root test. 


The Root Test for Power Series. Let paeee Cn(t — to)" be a given power series and 
suppose L = limy-+o0 ¥/ |Cn|. Define R in the following way: 


=2 i Oe Led, 
R=0 if L=o, 


Then 
i. The power series converges only att = tj if R = 0. 
ii. The power series converges for all t € Rif R = oo. 


iii. The power series converges if |f — to| < R and diverges if |f —to| > R. 
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28. Use the root test to determine the radius of convergence of }°°° 4 c. 


29. Let c, = 1 ifm is odd and c, = 2 if n is even. Consider the power series 
Loam cnt” . Show that the ratio test does not apply. Use the root test to determine 
the radius of convergence. 


30-34. In this sequence of exercises, we consider a function that is infinitely 
differentiable but not analytic. Let 


30. Compute f’(t) and f”(t) and observe that f(t) = er Pn(+) where py, is a 
polynomial, n = 1,2. Find p; and po. 

31. Use mathematical induction to show that f(t) = eT Pn(4) where p, is a 
polynomial. 

32. Show that lim,_,o+ f(t) = 0. To do this, let u = 4 in f(t) = eT p, (4) 
and let u — oo. Apply L’Hospital’s rule. 

33. Show that f”(0) = 0 for alln = 0,1,.... 

34. Conclude that f is not analytic at t = 0 though all derivatives at t = 0 exist. 
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7.2 Power Series Solutions About an Ordinary Point 


A point f is called an ordinary point of Ly = 0 if we can write the differential 
equation in the form 


y” +ai(t)y’ + ao(t)y = 0, (1) 


where ao(t) and a;(t) are analytic at fo. If fo is not an ordinary point, we call it a 
singular point. 


Example 1. Determine the ordinary and singular points for each of the following 
differential equations: 


ly" + ay + ay =0. 

2. (1—t?)y” — 2ty’ + n(n + 1)y = 0, where n is an integer. 

3. ty” + (sint)y’ + (e —l)y = 0. 

> Solution. 

1. Here a,(t) = why is analytic except att = +3. The function aj = vat is 
analytic except at tf = —1. Thus, the singular points are —3, 3, and —1. All other 


points are ordinary. 


2. This is Legendre’s equation. In standard form, we find a,(t) = —4 


1-17 
ae. They are analytic except at 1 and —1. These are the singular points and 
all other points are ordinary. 


and ao(t) = 


3. In standard form, a,(t) = sat and ag(t) = e, Both of these are analytic 
everywhere. (See Exercises 13 and 14 of Sect. 7.1.) It follows that all points are 
ordinary. < 


In this section, we restrict our attention to ordinary points. Their importance is 
underscored by the following theorem. It tells us that there is always a power series 
solution about ordinary points. 


Theorem 2. Suppose do(t) and a,(t) are analytic at to, both of which converge for 
|t — to| < R. Then there is a unique solution y(t), analytic at to, to the initial value 
problem 


y"+a(y' +at)y =0, y(to) =a, y'(to) = B. (2) 
If 
[o) 
yt) =o enlt — )" 
n=0 
then co = a, Cc, = B, and all other cy, k = 2,3,..., are determined by co and c}. 


Furthermore, the power series for y converges for |t —to| < R. 


Of course the uniqueness and existence theorem, Theorem 6 of Sect. 5.1, implies 
there is a unique solution. What is new here is that the solution is analytic at f9. Since 
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the solution is necessarily unique, it is not at all surprising that the coefficients are 
determined by the initial conditions. The only hard part about the proof, which we 
omit, is showing that the solution converges for |t — to| < R. Let y, be the solution 
with initial conditions y(fo) = 1 and y’(to) = O and yy the solution with initial 
condition y(fo) = 0 and y’(t) = 1. Then it is easy to see that y; and y2 are 
independent solutions, and hence, all solutions are of the form c;y; + C2y2. (See 
Theorem 2 of Sect. 5.2) The power series method refers to the use of this theorem 
by substituting y(t) = )°°2. cn(¢ — to)” into (2) and determining the coefficients. 

We illustrate the use of Theorem 2 with a few examples. Let us begin with a 
familiar constant coefficient differential equation. 


Example 3. Use the power series method to solve 


" 


y +y=0. 


> Solution. Of course, this is a constant coefficient differential equation. Since 
q(s) = s*+1 and B, = {cost, sint}, we get solution y(t) = c) sint +c. cost. Let 
us see how the power series method gives the same answer. Since the coefficients 
are constant, they are analytic everywhere with infinite radius of convergence. 
Theorem 2 implies that the power series solutions converge everywhere. Let y(t) = 
yt bea ies ab = 0. Th 

nag Cn power series about fp = 0. Then 


CO 
y= ane 


n=1 


[o,@) 
and y"(t) = > can(n — 1)t"~?, 


n=2 


An index shift, n > n + 2, gives y"(t) = \o>29 cn4o(n + 2)(n + 1)t”. Therefore, 
the equation y” + y = 0 gives 


co 


Yin + enga(n + 2)(n + 1))t" = 0, 


n=0 
which implies c, + Cy42(n + 2)(n + 1) = 0, or, equivalently, 


—Ch 
Cn42 = ——————_  _ foralln = 0, 1.,.... 3 
2= Gp Da@d) (3) 


Equation (3) is an example of a recurrence relation: terms of the sequence are 
determined by earlier terms. Since the difference in indices between c,, and C,+2 is 
2, it follows that even terms are determined by previous even terms and odd terms 
are determined by previous odd terms. Let us consider these two cases separately. 
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The Even Case The Odd Case 
= — =c0 = = TAL 
n=0 2= 3 = 1 c= 39 
= = 22 = 2. = = a 2S SN ee EL 
n=2 C= 43 = a3271 74 n=3 Cs = 34 = 5432 = 31 
= — 24 — =e = — 25 — x1 
n=4 C= 6S = 6 n=5 C7 = 76 = 
=¢ Cc =e c 
n=6 = i=8 n=7 = i=g 


More generally, we can see that Similarly, we see that 


Cn = (— 1)" 


oat Con+1 = (-1 ~ (2n i a 


Now, as we mentioned in Sect. 7.1, we can change the order of absolutely convergent 
sequences without affecting the sum. Thus, let us rewrite y(t) = Yo 9 cat” in 
terms of odd and even indices to get 


y(t) — sas tn + 5 cont? 


n=0 n=0 


1)’ ten 4 (= 1)" pent 
oy S (2n yr aD eo 4 (2n + pr 


n=0 


I 


=cocost +c, sint, 


where the first power series in the second line is that of cost and the second power 
series is that of sint (See (3) and (4) of Sect. 7.1). | 


Example 4. Use the power series method with center t9 = 0 to solve 
(1 +27)y" + 4ty’ + 2y =0. 

What is a lower bound on the radius of convergence? 

> Solution. We write the given equation in standard form to get 


y+ At yi + y= 
14+? 14+? 


0. 


Since the coefficient functions a) (¢) = 7 4 Te and a(t) = 7 ae =z are rational functions 
with nonzero denominators, they are analytic at all points. By Theorem 13 of 
Sect. 7.1, it is not hard to see that they have power series expansions about fg = 0 
with radius of convergence 1. By Theorem 2, the radius of convergence for a 
solution, y(t) = Ss cyt” is at least 1. To determine the coefficients, it is easier 
to substitute y(t) directly into (1 + t?)y” + 4ty’ + 2y = 0 instead of its equivalent 
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standard form. The details were worked out in Example 8 of Sect.7.1. We thus 
obtain 


[o,@) 
(1+ 2?)y" + 4ty! + 2y = D> (cnr + n(n + 2 + 1)" = 0. 
n=0 


From this equation, we get c,42 +c, = 0 for alln = 0, 1,---. Again we consider 
even and odd cases. 


The Even Case The Odd Case 
n C2 = —Co n=1 C3 = -C\ 
n=2 C4 = —C2 = CO n=3 Cs = —C3 = Cj 
n=4 C6 = —Co n=5 c7 = -C} 
More generally, we can see that Similarly, we see that 
Con = (—1)"co. Conti = (-1)"c1. 


It follows now that 


y(t) = co yo(-1)"2" +¢ Saye. 


n=0 n=0 


As we observed earlier, each of these series has radius of convergence at least 1. In 
fact, the radius of convergence of each is 1. < 


A couple of observations are in order for this example. First, we can relate the 
power series solutions to the geometric series, (5) of Sect. 7.1, and write them in 
closed form. Thus, 


ea = yey" = 1 


7 
n=0 n=0 1+? 
CO [oe t 
—] ny2n+ =f _f? n : 
Ene a Cit a rep 
n=0 n=0 
. . 1 
It follows now that the general solution is y(t) = Cop + C17 = Second, 


since a;(t) and a(t) are continuous on R, the uniqueness and existence theorem, 
Theorem 6 of Sect.5.1, guarantees the existence of solutions defined on all of R. It 
is easy to check that these closed forms, a and reeee are defined on all of IR and 
satisfy the given differential equation. 

This example illustrates that there is some give and take between the uniqueness 
and existence theorem, Theorem 6 of Sect. 5.1, and Theorem 2 above. On the one 
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hand, Theorem 6 of Sect.5.1 may guarantee a solution, but it may be difficult or 
impossible to find without the power series method. The power series method, 
Theorem 2, on the other hand, may only find a series solution on the interval of 
convergence, which may be quite smaller than that guaranteed by Theorem 6 of 
Sect. 5.1. Further analysis of the power series may reveal a closed form solution 
valid on a larger interval as in the example above. However, it is not always possible 
to do this. Indeed, some recurrence relations can be difficult to solve and we must be 
satisfied with writing out only a finite number of terms in the power series solution. 


Example 5. Discuss the radius of convergence of the power series solution about 
to = Oto 
(l-‘)y"+y =0. 


Write out the first five terms given the initial conditions 
y(0)=1 and y'(0)=0. 


> Solution. In standard form, the differential equation is 


Thus, a,(t) = 0, ao(t) = a and f9 = 0 is an ordinary point. Since ao(t) is 
represented by the geometric series, which has radius of convergence 1, it follows 
that any solution will have radius of convergence at least 1. Let y(t) = 772.9 ent”. 


Then y” and —ty” are given by 


CO 
y(t) =o cnet (n+ De", 
n=0 


[o) 


—ty"(t) = > —e,n(n — 1)t" |, 
n=2 
[o.@) 

= a —Ch41(n + 1)nt". 
n=0 


It follows that 


CO 
(—a)y”+y¥ =) Catala + DOF 1) —cngi(n + In + cn)E”, 


n=0 


which leads to the recurrence relations 


Cno2(n + 2)(n + 1) — cryin + Dn + cy = 0, 
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for alln = 0,1,2,.... This recurrence relation is not easy to solve generally. We 
can, however, compute any finite number of terms. First, we solve for c;+2: 


1 


= (4) 
n+2 (n + 2)(n + 1) 


Cnt+2 = Cn+1 


The initial conditions y(0) = 1 and y’(0) = 0 imply that co = 1 and c,; = 0. 
Recursively applying (4), we get 


n=0 O=C O0-cos =; 
n= S=a,=t, ==p 
= C= tay Cag = =a 
n cs = e428 — 035 =-4. 


It now follows that the first five terms of y(t) is 


1 1 1 
2 a ee ee ee < 
y(t) a ie 


In general, it may not be possible to find a closed form description of c,. 
Nevertheless, we can use the recurrence relation to find as many terms as we desire. 
Although this may be tedious, it may suffice to give an approximate solution to a 
given differential equation. 

We note that the examples we gave are power series solutions about fo = 0. 
We can always reduce to this case by a substitution. To illustrate, consider the 
differential equation 


iy! = @= ly =ty = 0. (5) 


It has tg = 1 as an ordinary point. Suppose we wish to derive a power series 
solution about fo = 1. Let y(t) be a solution and let Y(x) = y(x + 1). Then 
Y'(x) = y’(x + 1) and Y"(x) = y"’(x + 1). In the variable x, (5) becomes 
(x + LY” (x) — xY'(x) — (& + 1) Y(x) = 0 and xo = 0 is an ordinary point. We 
solve Y(x) = }°°2.) cnx" as before. Now let x = t — 1. That is, y(t) = Y(t—1) = 
un Cy(t — 1)” is the series solution to (5) about tp = 1. 


Chebyshev Polynomials 


We conclude this section with the following two related problems: For a nonnegative 
integer n, expand cosnx and sinnx in terms of just cos x and sin x. It is an easy 
exercise (see Exercises 12 and 13) to show that we can write cosnx as a polynomial 
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in cos x and we can write sinnx as a product of sinx and a polynomial in cos x. 
More specifically, we will find polynomials 7, and U,, such that 


cosnx = T, (cos x), 
sin(n + 1)x = sin x U, (cos x). (6) 

(The shift by 1 in the formula defining U,, is intentional.) The polynomials 7, and 
U,, are called the Chebyshev polynomials of the first and second kind, respectively. 
They each have degree n. For example, ifn = 2, we have cos 2x = cos” x—sin? x = 
2cos? x — 1. Thus, T)(t) = 2t? — 1; if t = cos x, we have 

cos 2x = T,(cos x). 
Similarly, sin 2x = 2 sin x cos x. Thus, U;(t) = 2t¢ and 

sin 2x = sinxU\(cos x). 


More generally, we can use the trigonometric summation formulas 


sin(x + y) = sinx cos y + cos x sin y, 


cos(x + y) = cos x cos y — sin x sin y, 
and the basic identity sin* x + cos? x = 1 to expand 
cosnx = cos((n — 1)x + x) = cos((n — 1)x) sin x — sin((m — 1)x) sin x. 


Now expand cos((m — 1)x) and sin((m — 1)x) and continue inductively to the point 
where all occurrences of coskx and sinkx, k > 1, are removed. Whenever sin” x 
occurs, replace it by 1 — cos? x. In the table below, we have done just that for some 
small values of n. We include in the table the resulting Chebyshev polynomials of 
the first kind, T,,. 


n cos nx T,(t) 

0 cosOx = 1 To(t) = 1 

1 cos lx = cos x T(t) =t 

2 cos2x = 2cos*x — 1 To(t) = 217-1 

3 cos 3x = 4cos* x — 3cosx T3(t) = 40? —3¢t 

4 cos4x = 8costx —8cos*x+1 7y(t) = 8t4*-— 81741 
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In a similar way, we expand sin(n + 1)x. The following table gives the Chebyshev 
polynomials of the second kind, U,,, for some small values of n. 


n sin(n + 1)x U,,(t) 

0 sin lx = sinx Udj(t) = 1 

1 sin2x = sin x(2cos x) U\(t) = 2t 

2 | sin3x = sinx(4cos? x — 1) U2(t) = 417 -1 

3. | sin4x = sin x(8 cos? x — 4cos x) U3(t) = 81? —4t 

4 sin 5x = sinx(16cos*x —12cos?x+1) U,(t) = 16¢* — 127741 


The method we used for computing the tables is not very efficient. We will use 
the interplay between the defining equations, (6), to derive second order differential 
equations that will determine 7,, and U,,. This theme of using the interplay between 
two related families of functions will come up again in Sect. 7.4. 

Let us begin by differentiating the equations that define 7, and U,, in (6). For the 
first equation, we get 


d 
LHS: ae cosnx = —nsinnx = —n sinxU,_1(cos x), 
x 
d ;: F 
RHS: ae T, (cos x) = T, (cos x)(— sin x). 
x 
Equating these results, simplifying, and substituting t = cos x gives 
T,(t) = nUp-1(t). (7) 
For the second equation, we get 
d . 
LHS: a sin(n + 1)x = (n+ 1)cos(v + 1)x = (n + 1)T,,41(cos x), 
x 


d 
RHS: ae sin xU,,(cos x) = cos xU,(cos x) + sinxU/ (cos x)(— sin x) 
x 


= cos xU,(cos x) — (1 — cos” x)U; (cos x). 


It now follows that (n + 1)Ty41(t) = tU,(t) — (1 —t?)U/(t). Replacing n byn — 1 
gives 


nT, (t) = tUn-r(t) — (1 -t7)U,_,@). (8) 
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We now substitute (7) and its derivative T(t) = nU/_,(t) into (8). After 
simplifying, we get that 7, satisfies 


(l—2°)T"(t) — tT) + n°T,(t) = 0. (9) 
By substituting (7) into the derivative of (8) and simplifying we get that U,, satisfies 
(1—2?)U/ (t) — 3tU, + n(n + 2)U,(t) = 0. (10) 

The differential equations 
=P )y"O —ty' + yO =0 (11) 
(—f)y"(O) — 3ty’ + a@ + 2)y(1) = 0 (12) 
are known as Chebyshev’s differential equations. Each have to = +1 as singular 


points and tf = O is an ordinary point. The Chebyshev polynomial 7, is a 
polynomial solution to (11) and U,, is a polynomial solution to (12), when a = n. 


Theorem 6. We have the following explicit formulas for T,, and U,,; 


Ton) = mC? EAC 


~ —k)! (2k)!" 
2n - 1 a pa +k)! (21)! 
Tang i (t) = (-1) 2 D (n—k)! (2k +0)! 


k= 


= n “ x(a +k)! (21)* 
Uo) = 1" CD Car er” 


k=0 


_ ; n ~atk+ 1)! (21) +! 
Urn4i(t) = (-1) we 1) (n—k)! (Qk +)! 


Proof. Let us first consider Chebyshev’s first differential equation, for general a. 
Ley) = cxt*. Substituting y(t) into (11), we get the following relation 
for the coefficients: 

—(o? — kek 


“+2 = Ey (e+ I)” 


Let us consider the even and odd cases. 


514 7 Power Series Methods 


The Even Case 

a? — 07 

c= 2-1 (a) 

= Oe OP EZ OPH 0) 

PO hae ee 4! cu 
a2 =— 4? (a? = 4?) (a? = 27) (ar os 07) 

eo=- C4 = Co 

6-5 6! 


More generally, we can see that 


(a* — (2k — 2)’)---(@? — 0°) 
Co, = (—1)* Co. 
2 = (-1) Qk! 0 
By factoring each expression a? — (2/)? that appears in the numerator into 


2° ($ + j) ($ — j) and rearranging factors, we can write 


Coe = (12 (Stee) (bd) ($) (g + Inen(S ak 1) 52% 
2 (2k)! es 
The Odd Case 
7 (a? — 17) 
aia Ee 
(a? =_ 37) (a? = 37) (ar _ i) 
== 3 Cl 
5-4 5! 
(a? _ 57) (a? = 5*) (a? a 37) (a? = 17) 
== 2 = = Cy 
7-6 7! 


Similarly, we see that 


. (a? — (2k -1)*)---(@? = 1) | 
(2k +1)! 


Cx+1 = (-1 


By factoring each expression a” — (27 — 1)? that appears in the numerator into 
oa (s+ + ji) (4 -G- 1)) and rearranging factors, we get 


(254 +) (9-&-D) oe 
eS 
(Qk +1)! 


cor+1 = (-1)k 
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Let 
at He tea Wes aes |) 2k 
Yo = 7) OB! (21) 
and 
= ix (Sth) 2S = &=)) 2k+1 
= 5 LCD Qk + 1! as 


k=0 


Then the general solution to Chebyshev’s first differential equation is 


y=coyvot cry. 


It is clear that neither yp nor y; is a polynomial if w is not an integer. 


The Casea = 2n 


In this case, yo is a polynomial while y; is not. In fact, for k > n, the numerator 
in the sum for yo is zero, and hence, 


(nt+k—1)--(—k+1) 
(2k)! 


yo(t) =n )\(-1) (2t)** 


k=0 


- et A 1 On 
=e ) —bB! Qi! 


It follows 7>,(t) = coyo(t), where co = Tr, (0). To determine 7>,, (0), we evaluate 
the defining equation 7, (cosx) = cos2nx at x = 5 to get Tr,(0) = cosna = 
(—1)”. The formula for 7>, now follows. 


The Casea = 2n+1 


In this case, y; is a polynomial while yo is not. Further, 


be kj) (n—-k +1 
yi(t) = ; dE (n + ms “= + ) apt 
k=0 . 


7 ; +k)! (2r)2+! 
pie ) —k)! Qk +1)! 
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It now follows that 7>,4,(¢) = c,y,(t). There is no constant coefficient term in 
yi. However, y;(0) = 1 is the coefficient of t in y,. Differentiating the defining 
equation T>,, 4; (cos x) = cos((2n+1)x) atx = 5 gives Tj, , (0) = (2n+1)(-1)". 
Let c) = (2n + 1)(—1)". The formula for 7}, now follows. The formulas for U,, 
/ 


follow from (7) which can be written U,, = a nel oO 
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Exercises 


1-4. Use the power series method about f9 = 0 to solve the given differential 
equation. Identify the power series with known functions. Since each is constant 
coefficient, use the characteristic polynomial to solve and compare. 

1. y’-y=0 

2. y’—-2y’+y =0 

3. y" +k?y = 0, wherek €R 

4. y” —3y'+2y =0 
5-10. Use the power series method about fo = 0 to solve each of the following 
differential equations. Write the solution in the form y(t) = coyo(t) + ciyi(t), 
where yo(0) = 1, y4(0) = 0 and y\(0) = 0, y(t) = 1. Find yo and y; in closed 
form. 

5. 1—-2)y"+2y=0 -1<t<1 
. (1 —2?)y"” —2ty’+2y=0 -1<t<1 
(¢-ly” —ty’ +y =0 
. (4+ 2?)y” —2ty’+2y =0 
. (+ 2*)y" —4ty’ + 6y =0 
10. (1—t?)y" —6ty’ —4y =0 
11-19. Chebyshev Polynomials: 


Oo OND 


11. Use Euler’s formula to derive the following identity known as de Moivre’s 
formula: 
(cosx +i sinx)" = cosnx +i sinnx, 


for any integer 7. 
12. Assume n is a nonnegative integer. Use the binomial theorem on de Moivre’s 
formula to show that cos nx is a polynomial in cos x and that 


L4 
T(t) = (;,)°% = Py 


k=0 


13. Assume 7 is a nonnegative integer. Use the binomial theorem on de Moivre’s 
formula to show that sin(n + 1)x is a product of sin x and a polynomial in cos x 
and that 


n n+1\ nox 2k 
mo= > (ai) dry. 
14. Show that 

(1 —27)U, (t) = tTr41t) — Tr42(2). 
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15. Show that 


16. Show that 


17. Show that 


18. Show that 


19. Show that 


Un4i(t) = tUn(t) + Troi). 


Th41(t) = 2tT,, (t) = Tr-1(t). 

Un+i(t) = 2tU,,(t) rz Uni (0). 
1 

GOs Unt) = Un—2(t)) . 


1 
U,(t) = 2 (T(t) _ Tn+2(t)) . 
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7.3 Regular Singular Points and the Frobenius Method 


Recall that the singular points of a differential equation 
y" +ai(t)y’ + ao(t)y = 0 (1) 


are those points for which either ai(¢) or ao(t) is not analytic. Generally, they are 
few in number but tend to be the most important and interesting. In this section, we 
will describe a modified power series method, called the Frobenius Method, that 
can be applied to differential equations with certain kinds of singular points. 

We say that the point fp is aregular singular point of (1) if 


1. fp is a singular point. 
2. Aj(t) = (t — to)ay(t) and Ao(t) = (t — t9)*ao(t) are analytic at fo. 


Note that by multiplying a,(¢) by t — fo and ao(t) by (t — to)”, we “restore” the 
analyticity at fo. In this sense, a regular singularity at fo is not too bad. A singular 
point that is not regular is called irregular. 


Example 1. Show f = 0 is a regular singular point for the differential equation 


ty” +tsinty’ —2(t+ ly =0. (2) 
> Solution. Let us rewrite (2) by dividing by t*. We get 


y” + 


sint_, 2(¢+1) 
ne 


While a,(t) = ant is analytic at 0 (see Exercise 13, of Sect.7.1) the coefficient 
—2(t+1) sint 
12 t 
= —2(1 + 2) are analytic at fg = 0. It follows that f9 = 0 is a regular 


singular point. < 


function ao(t) = = sint and t?ao(t) = 


—2(t+1 
ce ) 


is not. However, both ta,(t) = t 


In the case of a regular singular point, we will rewrite (1): multiply both sides by 
(t — to)? and note that 


(t —t)’ai(t) = (t—to)Ai(t) and = (t —f9)ao(t) = Ao(t). 


We then get 
(t — to)’ y"” + (t—t)Ai(t)y’ + Ao(t)y = 0. (3) 


We will refer to this equation as the standard form of the differential equation when 
to is a regular singular point. By making a change of variable, if necessary, we can 
assume that f9 = 0. We will restrict our attention to this case. Equation (3) then 
becomes 


ty” + tAy(t)y’ + Ao(t)y = 0. (4) 
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When A(t) and Ao(t) are constants then (4) is a Cauchy—Euler equation. We 
would expect that any reasonable adjustment to the power series method should able 
to handle this simplest case. Before we describe the adjustments let us explore, by 
an example, what goes wrong when we apply the power series method to a Cauchy— 
Euler equation. Consider the differential equation 


2t7y” + 5ty’ -—2y = 0. (5) 


Let yy) => 4 cat”. The 


[o.e) 
2t7y"” = Y-2n(n — ent", 


n=0 


Co 
iy = ye 5ncyt", 


n=0 
[eve) 


2y= So 2ent”. 


n=0 
Thus, 


CO [o,@) 
2t7y" + 5ty’-—2y = YS Qntn —1)+5n—2)eyt" = Y (an —1)(n + 2)ent”. 


n=0 n=0 


Equation (5) now implies (2n — 1)(n + 2)c, = 0, and hence c, = 0, for all 
n=0,1,.... The power series method has failed; it has only given us the trivial 
solution. With a little forethought, we could have seen the problem. The indicial 
polynomial for (5) is 2s? +5s—2 = (2s—1)(s +2). The roots are 5 and —2. Thus, 


a fundamental set is {i 2 ; and neither of these functions is analytic at fo = 0. 


Our assumption that there was a power series solution centered at 0 was wrong! 

Any modification of the power series method must take into account that 
solutions to differential equations about regular singular points can have fractional 
or negative powers of f, as in the example above. It is thus natural to consider 
solutions of the form 


yO=t" > cat", (6) 


n=0 


where r is a constant to be determined. This is the starting point for the Frobenius 
method. We may assume that cp is nonzero for if co = 0, we could factor out a 
power of f and incorporate it into ,. Under this assumption, we call (6) a Frobenius 
series. Of course, if r is a nonnegative integer, then a Frobenius series is a power 
series. 
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Recall that the fundamental sets for Cauchy—Euler equations take the form 
7,07}, {t’,t7 Int}, and {t* cos # lnt,t® sin B Int}. 


(cf. Sect.5.3). The power of t depends on the roots of the indicial polynomial. 
For differential equations with regular singular points, something similar occurs. 
Suppose A;(f) and Ao(t) have power series expansions about fo = 0 given by 


Aj(t) =a + ait + ant? +++» and  Ao(t) = bo + bit + bot? +++. 
The polynomial 


q(s) = s(s — 1) + aos + bo (7) 


is called the indicial polynomial associated to (4) and extends the definition given 
in the Cauchy—Euler case.! Its roots are called the exponents of singularity and, as 
in the Cauchy—Euler equations, indicate the power to use in the Frobenius series. A 
Frobenius series that solves (4) is called a Frobenius series solution. 


Theorem 2 (The Frobenius Method). Suppose to = 0 is a regular singular point 
of the differential equation 


ty” + tAy(t)y’ + Ao(t)y = 0. 


Suppose r; and rz are the exponents of singularity. 


The Real Case: Assume r, and rz are real and r, > ro. There are three cases to 
consider: 


1. If r, — rz is not an integer, then there are two Frobenius solutions of the form 


[o,@) [oe) 
7WOS0 a” ad pO? > Gr. 


n=0 n=0 


2. If r; — r2 is a positive integer, then there is one Frobenius series solution of the 
form 


CO 
ni aat ot 


n=0 


and a second independent solution of the form 


[o,@) 
y(t) = eyi(t)Int +1? YC, t". 


n=0 


'If the coefficient of t? y” is a number c other than 1, we take the indicial polynomial to be g(s) = 


cs(s — 1) + aos + Do. 
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It can be arranged so that € is either 0 or 1. When e = 0, there are two Frobenius 
series solution. When € = 1, then a second independent solution is the sum of a 
Frobenius series and a logarithmic term. We refer to these as the nonlogarithmic 
and logarithmic cases, respectively. 

3. fr; —rz = 0, letr =r, = r2. Then there is one Frobenius series solution of the 
form 


love) 
yi(t) = L et 


n=0 


and a second independent solution of the form 


le. e) 
yo(t) = y(t) Int +0" Ps Cr 


n=0 


The second solution y> is also referred to as a logarithmic case. 


The Complex Case: If the roots of the indicial polynomial are distinct complex 
numbers, r and T say, then there is a complex-valued Frobenius series solution of 
the form 


[o.@) 
y(t) =t" Sent”, 


n=0 


where the coefficients c, may be complex. The real and imaginary parts of y(t), 
yi(t), and y(t), respectively, are linearly independent solutions. 
Each series given for all five different cases has a positive radius of convergence. 


Remark 3. You will notice that in each case, there is at least one Frobenius 
solution. When the roots are real, there is a Frobenius solution for the larger of the 
two roots. If y; is a Frobenius solution and there is not a second Frobenius solution, 
then a second independent solution is the sum of a logarithmic expression y,(¢) Int 
and a Frobenius series. This fact is obtained by applying reduction of order. We 
will not provide the proof as it is long and not very enlightening. However, we will 
consider an example of each case mentioned in the theorem. Read these examples 
carefully. They will reveal some of the subtleties involved in the general proof and, 
of course, are a guide through the exercises. 


Example 4 (Real Roots Not Differing by an Integer). Use Theorem 2 to solve 
the following differential equation: 


2ry” + 34(14+0)y’—y =0. (8) 


> Solution. We can identify A;(¢) = 3+ 3¢ and Ao(t) = —1. It is easy to see that 
to = Ois a regular singular point and the indicial equation 


q(s) = 2s(s —1) +3s—1 = (257 + s—1) = 5—-1)(5 4+ 1). 


7.3 Regular Singular Points and the Frobenius Method 523 


The exponents of singularity are thus 5 and —1, and since their difference is not an 
integer, Theorem 2 tells us there are two Frobenius solutions: one for each exponent 
of singularity. Before we specialize to each case, we will first derive the general 
recurrence relation from which the indicial equation falls out. Let 


fore) foe) 
y(t) =?" yor — on 


n=0 n=0 
Then 
[o,@} CO 
y(t) = Yia +r)ct" | and y= Yin t+r)\(atr—le)t??. 
n=0 n=0 


It follows that 


CO 
20? y"(th=t Y2M4+ra+r—Vent”, 


n=0 


[o.@) 
3ty'(t) = 0" > 3(n+r)cat", 


n=0 


oe) oe) 
307 y/(t) = 0" > 3(n +r)ent"t! = t" > 5(n—14+17r)cp-it", 


n=0 n=1 


[oe 
—y(t)=t' So ent”. 


n=0 


The sum of these four expressions is 2¢7y” + 3t(1 + t)y’ — ly = 0. Notice that 
each term has t’ as a factor. It follows that the sum of each corresponding power 
series is 0. They are each written in standard form so the sum of the coefficients with 
the same powers must likewise be 0. For n = 0, only the first, second, and fourth 
series contribute constant coefficients (t°), while form > 1, all four series contribute 
coefficients for t”. We thus get 


n=0 (2r(r — 1) + 3r —1)co = 0,7 
n>1 Qa+r)n+r—-1I4+3+r)—Den +3 —1+r)cen-1 = 0. 


Now observe that for 7 = 0, the coefficient of co is the indicial polynomial g(r) = 
2r(r—1)+3r—1 = (2r—1)(r +1), and forn > 1, the coefficient of c, is g(n +1). 
This will happen routinely. We can therefore rewrite these equations in the form 
n=0 q(r)co = 0 
n>1 qin +r)en + 3(n-—14+4r)en—-1 = 0. (9) 
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Since a Frobenius series has a nonzero constant term, it follows that g(r) = 0 
implies r = 5 and r = —1, the exponents of singularity derived in the beginning. 
Let us now specialize to these cases individually. We start with the larger of the two. 


The Case r = s Letr = 5 in the recurrence relation given in (9). Observe that 
q(in+ 5) = 2n (n+ 3) = n(2n + 3) and is nonzero for all positive n since the only 
roots are 5 and —1. We can therefore solve for c,, in the recurrence relation and get 


—3(n — 5) -(3) (2n — 1) 


ee 
ROn3) ON 2 nea) st) 


Cn 


Recursively applying (10), we get 


= 3 eee 3 

n= C\ (S) a (>) 

3 (-3\" 3 

sa (>) 527.5) 

= _(-3\ 5 [738 53 _ (3) 3 

as i (SF) > oa (>) ae 


7 _(-3\' 3 
PES Bie (=) yar 9) °°" 


2 n\(2n+3)(2n+1) 
into the Frobenius series with r = 5 to get 


2 = =3 “ 3 n 
n= y( | nln OnE” 


n=0 


Generally, we have c, = ( Co. We let co = | and substitute c, 


The Case r = —1. In this case, g(n + r) = q(n — 1) = (2n — 3)(n) is again 
nonzero for all positive integers n. The recurrence relation in (9) simplifies to 
n—2 


Gna (11) 


Ch = 


Recursively applying (11), we get 


n=1 q= 319 = —3¢9 
n=2 C2 = 0c; = 0 


n=3 c3 = 0 


Again, we let co = 1 and substitute c, into the Frobenius series with r = —1 to get 
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1—3t 


ya(t) = 1! (1-31) = ; 


Since y; and y» are linearly independent, the solutions to (8) is the set of all linear 
combinations. < 


Before proceeding to our next example let us make a couple of observations that 
will apply in general. It is not an accident that the coefficient of cg is the indicial 
polynomial q. This will happen in general, and since we assumed from the outset 
that co 4 0, it follows that if a Frobenius series solution exists, then g(r) = 0; that 
is, r must be an exponent of singularity. It is also not an accident that the coefficient 
of c, is g(n +r) in the recurrence relation. This will happen in general as well. If 
we can guarantee that q(n + r) is not zero for all positive integers n, then we obtain 
a consistent recurrence relation, that is, we can solve for c, to obtain a Frobenius 
series solution. This will always happen for r,, the larger of the two roots. For the 
smaller root rz, we need to be more careful. In fact, in the previous example, we 
were careful to point out that g(n + r2) 4 0 forn > 0. However, if the roots differ 
by an integer, then the consistency of the recurrence relation comes into question in 
the case of the smaller root. The next two examples consider this situation. 


Example 5 (Real Roots Differing by an Integer: The Nonlogarithmic Case). 
Use Theorem 2 to solve the following differential equation: 


ty” +2y’+ty =0. 


> Solution. We first multiply both sides by ¢ to put in standard form. We get 


ty” + 2ty’ +t?y =0 (12) 


and it is easy to verify that 4) = 0 is a regular singular point. The indicial polynomial 
is q(s) = s(s —1) + 2s = 5? +5 = s(s + 1). It follows that 0 and —1 are the 
exponents of singularity. They differ by an integer so there may or may not be a 
second Frobenius solution. Let 


[oe 
y(t) =t" ea" 
n=0 
Then 


[o.e) 
ry"(t) = 0" Yin +r)(n+r—1)c,t", 


n=0 


[oe 
2ty’(Q)=t D0 204 rent”, 


n=0 


526 7 Power Series Methods 


[o.@) 
PO =0 > Gaal 


n=2 


The sum of the left side of each of these equations is t7y” + 2ty’ + t?y = 0, and, 
therefore, the sum of the series is zero. We separate then = 0,n = 1, andn > 2 
cases and simplify to get 


n=0 (r(r+1))co = 0, 
n=1 ((rt+1)(r4+2))c; = 0, 
n>2 (n+r)\(n +r 4+ 1))en + Cr-2 = 0. (13) 


The n = 0 case tells us that r = 0 orr = —1, the exponents of singularity. 

The Case r = 0. If r = 0 is the larger of the two roots, then the n = | case in 
(13) implies c; = 0. Also q(n +r) = q(n) = n(n + 1) is nonzero for all positive 
integers n. The recurrence relation simplifies to 


—Cn—2 


~ (n+ 1)n 


Cn 


Since the difference in indices in the recurrence relation is 2 and c, = 0, it follows 
that all the odd terms, c2,,+41, are zero. For the even terms, we get 


=2 pepe 
i ae 
—C2 Co 
=4 = = 
i ee Bl 
=C4 —Co 
n=6 o= — , 
Oe a 
and generally, co, = Co. If we choose cp = 1, then 
[o.e) 
(—1)"02" 
Hh= —_____ 
vil) Gre D! 


is a Frobenius solution (with exponent of singularity 0). 


The Case r = —1. In this case, we see something different in the recurrence 
relation. For in the n = 1 case, (13) gives the equation 


0-c; = 0. 


This equation is satisfied for all c;. There is no restriction on c; so we will choose 
c, = 0, as this is most convenient. The recurrence relation becomes 
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a= —Cn—-2 
"(a= nn’ 


A calculation similar to what we did above gives all the odd terms c2,+41 zero and 


ee a ae 
ee Woah 


If we set co = 1, we find the Frobenius solution with exponent of singularity —1 


co 


(-1)"0""! 
y2(t) = >» nyt 


n=0 
It is easy to verify that y|(t) = Sint and y2(t) = SS. Since y; and y2 are linearly 
independent, the solutions to (12) is the set of all linear combinations of y, 
and yo. < 


The main difference that we saw in the previous example from that of the first 
example was in the case of the smaller root r = —1. We had g(n — 1) = 0 when 
n = 1, and this leads to the equation c; -0 = 0. We were fortunate in that any c; is a 
solution and choosing c; = 0 leads to a second Frobenius solution. The recurrence 
relation remained consistent. In the next example, we will not be so fortunate. (If cy 
were chosen to be a fixed nonzero number, then the odd terms would add up to a 
multiple of y;; nothing is gained.) 


Example 6 (Real Roots Differing by an Integer: The Logarithmic Case). Use 
Theorem 2 to solve the following differential equation: 


ty" —t?y’ — 3t + 2)y = 0. (14) 


> Solution. It is easy to verify that tf) = 0 is a regular singular point. The indicial 
polynomial is g(s) = s(s — 1) —2 = s*—s5 —2 = (s — 2)(s + 1). It follows that 
2 and —1 are the exponents of singularity. They differ by an integer so there may or 
may not be a second Frobenius solution. Let 


lo, 
y(t) =" Sad". 


n=0 


Then 


lo. @) 
y(t) =t" Yin tr)n+r—1)eyt”, 


n=0 
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CO 
—ty'(t) =0" > —(n—14+17r)cy-1t", 


n=1 


loo) 
—3ty(t) =f" > —3¢n—1t", 


n=1 


lo) 
—2y(t) =0" y —2c,t”. 


n=0 


As in the previous examples, the sum of the series is zero. We separate the n = 0 
andn > | cases and simplify to get 


n=0 (r—2)(r+1)co = 0, 
n>1 (n+r—-2)(n+rt+1))ce,-(n+7r+2)cey,-) = 0. (15) 


The n = 0 case tells us that r = 2 or r = —1, the exponents of singularity. 


The Case r = 2. Since r = 2 is the larger of the two roots, the n > | case in 
(15) implies c, = eae We then get 


1 2 c 
n= cq = 
1 14° 
te May Bh yg 
3 7 7 
n= C3 = ——c2 = ——, 
e426 Shed 
and generally, c, = = +* C0. If we choose co = 4, then 
[oe [oe 
n+4 n+4 
t)h= t _ gl = gn 2 16 
yilt) dX a dX = (16) 


is a Frobenius series solution; the exponent of singularity is 2. (It is easy to see that 
yi(t) = (t? + 4t7)e’ but we will not use this fact.) 


The Case r = —1. The recurrence relation in (15) simplifies to 
n(n — 3)cy = —(n + MWen-1. 
In this case, there is a problem when n = 3. Observe 
n= 1 —2c; = 2c¢9 hence cj = —Co, 


n=2 —2c) = 3c) hence c= $0, 
=3 0-c3 = 4c2 = 660, SS 
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In the n = 3 case, there is no solution since co # 0. The recurrence relation is 
inconsistent and there is no second Frobenius series solution. However, Theorem 2 
tells us there is a second independent solution of the form 


vy) = yi@Ine +01 Dent”. (17) 


n=0 


Although the calculations that follow are straightforward, they are more involved 
than in the previous examples. The idea is simple though: substitute (17) into 
(14) and solve for the coefficients c,,n = 0,1,2,.... If y(t) is as in (17), then 
a calculation gives 


2." 2." 


CO 
ty" = yl Int + 2ty, — yi te! XC —1)(n—2)cnt", 


n=0 


lo, e) 
= —f?yi{Int—ty, +t" > —(n — 2)en-1t", 


n=1 


| 
a 
| 


os) 
—3ty = —3ty, Int + t} pa —3¢,-1t", 


n=1 


CO 
—2y =—2y, Int +t! D> —2c,2". 
n=0 


The sum of the terms on the left is zero since we are assuming a y is a solution. 
The sum of the terms with Inf as a factor is also zero since y, is the solution, (16), 
we found in the case r = 2. Observe also that the n = 0 term only occurs in the 
first and fourth series. In the first series, the constant term is (—1)(—2)co = 2c, 
and in the fourth series, the constant term is (—2)cp = —2cp. Since the n = 0 terms 
cancel, we can thus start all the series at = 1. Adding these terms together and 
simplifying gives 


0=21y,-¢ + Dy 
lo) 
+ Y (n(n = 3))Cn _ (n + 1)cy—1) t”. 


n=1 


(18) 


Now let us calculate the power series for 2ty, — (¢ + 1))1 and factor ¢~! out of the 
sum. A short calculation and some index shifting gives 


O°. 2(n + 4)(n + 2) _ 2(n+1)(n—-1), 
, n+2 _ 1 
a= 2 n!} ’ pty ee DGD (n — 3)! = “Gaar 


n=0 n=3 


> 
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n=0 n=3 
[o,) CO 
M+4 ,45 4 n(n—3)_, 
Sa Ga 
n=0 n=3 


Adding these three series and simplifying gives 


CO 
- (n + 3)(n—1) 
2ty, —(t 1 =f! ee 
y-@+)Dyn » (a —3)! 
We now substitute this calculation into (18), cancel out the common factor ¢~!, 
and get 


PS ee + Yoaa _ 3)Cn ~ (n aI 1)en—1)t" = 0. 


n=3 n=1 


We separate out them = | andn = 2 cases to get: 


n=1 —2c,; —2c9 = 0 hence c; = —co, 


n=2 —2c7 —3cy = 0 hence c= $0. 


For n > 3, we get 


3)(n -—1 
(a+ 3)a—)) + n(n = 3)Cn = (n + 1)¢n—-1 = 0 
(n — 3)! 
which we can rewrite as 
3)(n — 1 
n(n — 3)Cy = (n + 1)cCy—1 — Czy _) n> 3. (19) 
(n — 3)! 

You should notice that the coefficient of c, is zero when n = 3. As observed 


earlier, this led to an inconsistency of the recurrence relation for a Frobenius series. 
However, the additional term ere that comes from the logarithmic term results 
in consistency but only for a specific value of C2. To see this, let = 3 in (19) to 
get 0 = 0c3 = 4c. — 12 and hence cz = 3. Since c. = 3c0, we have that co = 2 
and c; = —2. We now have 0c3 = 4c. — 12 = 0, and we can choose c;3 to be any 


number. It is convenient to let cz; = 0. Form > 4, we can write (19) as 


_ al (n + 3)(n — 1) 
a= ae) OU 20) 
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Such recurrence relations are generally very difficult to solve in a closed form. 
However, we can always solve any finite number of terms. In fact, the following 
terms are easy to check: 


n=0 co = 2, n=4 c= 
n=1 cy = -2, n= 5 c= =P 
n=2 Co = 3, n=6 co = 383 
n=3 c; = 0, n=7 cy = 3. 


We substitute these values into (17) to obtain (an approximation to) a second linearly 
independent solution 


1 >» 21, 195 163, 53, 

yo(t) = y(t) Int+t (2 2t + 3t 4° ri a3! a5! i: < 
A couple of remarks are in order. By far the logarithmic cases are the most tedious. 
In the case just considered, the difference in the roots is 2 — (—1) = 3 and it was 
precisely at m = 3 in the recurrence relation where co is determined in order to 
achieve consistency. After n = 3, the coefficients are nonzero so the recurrence 
relation is consistent. In general, it is at the difference in the roots where this junction 
occurs. If we choose c3 to be a nonzero fixed constant, the terms that would arise 
with c3 as a coefficient would be a multiple of y;, and thus, nothing is gained. 
Choosing c3 = 0 does not exclude any critical part of the solution. 


Example 7 (Real roots: Coincident). Use Theorem 2 to solve the following 
differential equation: 


t?y"” —t(t + 3)y’ + 4y =0. (21) 


> Solution. It is easy to verify that f9 = 0 is a regular singular point. The indicial 
polynomial is g(s) = s(s — 1) — 3s +4 = s?—4s + 4 = (s — 2)’. It follows that 
2 is a root with multiplicity two. Hence, r = 2 is the only exponent of singularity. 
There will be only one Frobenius series solution. A second solution will involve a 
logarithmic term. Let 


lo. e) 
y(t) =0" Os Cat”. 


n=0 
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Then 


[o.@) 
ry (t)=t" Yia +r)\(n+r—l1)e,t", 


n=0 


loo) 
—ty'(t) =t" Yia ze a Wen-it", 


n=1 


[o,@) 
3ty'(t) = 0" J -3e,(n + ryt", 


n=0 


[o,@) 
4y(t) =¢t" ~ 4cyt”. 


n=0 


As in previous examples, the sum of the series is zero. We separate the n = O and 
n => | cases and simplify to get 


n=0 (r — 2)*cp = 0, 
n>1 (a+r—2)'c, = (n+r—l1)en-1. (22) 


The Case r = 2. Equation (22) implies r = 2 and 


n+1 
Ch = me a n= 1. 
n 
We then get 
n=1 qj= p00, 
n= Q= maa = arC0, 
n=3 3 = C2 = rg yrCo, 
and generally, 
(n+ 1)! n+1 
— o= Co. 
‘ (n!)? n! 
If we choose cy = 1, then 
[o,@) 
n+1 
2 n 
= —t 
WO=F Do (23) 
n=0 


is a Frobenius series solution (with exponent of singularity 2). This is the only 
Frobenius series solution. 
A second independent solution takes the form 


[ee) 
yt) = yi@)Int +? Yo ent”. (24) 
n=0 
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The ideas and calculations are very similar to the previous example. A straight- 
forward calculation gives 


[o,@) 
Py” =r yl Int + ty) —yi te? Yt Hat Vent”, 


n=0 


[o.e) 
—t’y =? y Int—ty +0? So -(n + 1)cn-1t", 


n=1 


[o.e) 
—3ty’ = —3ty{ Int —3y, + 2? > —3(n + 2)cpt", 


n=0 


fore) 
4y = 4y, Int + t? So 4ent”. 


n=0 


The sum of the terms on the left is zero since we are assuming a y is a solution. The 
sum of the terms with In ¢ as a factor is also zero since y, is a solution. Observe also 
that the n = O terms occur in the first, third, and fourth series. In the first series the 
coefficient is 2co, in the third series the coefficient is —6co, and in the fourth series 
the coefficient is 4cg. We can thus start all the series at n = 1 since then = O terms 
cancel. Adding these terms together and simplifying gives 


CO 
0 = 2ty,-— (+ 4 y1 $02 YO (Wen — (2 + Ven-1) t”. (25) 


n=1 


Now let us calculate the power series for 2ty; — (¢ + 4)y1 and factor ¢? out of the 
sum. A short calculation and some index shifting gives 


n+2 


G=D! = pi : (26) 


[o,@) 
2tyi-— (+4 y=? >> 


n=1 


We now substitute this calculation into (25), cancel out the common factor f?, and 
equate coefficients to get 


n+2 > 
mat! + nen — (n+ Men-1 = 0. 
Since n > 1, we can solve for c, to get the following recurrence relation: 
_ nti n+2 4 
Ch = ae a n(n!) ’ ni. 


As in the previous example, such recurrence relations are difficult to solve in a 
closed form. There is no restriction on cp so we may assume it is zero. The first few 
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terms thereafter are as follows: 


—173 
=0 =0, =4 = — , 
7 - ‘i “4 = 988 
—187 
n=1 cy = -3, n=5 c= ——, 
1200 
=| —4 
n=2 ee eee n=6 ie: 
4 14400 
—31 —971 
oS aS nat = 776400 


We substitute these values into (24) to obtain (an approximation to) a second 
linearly independent solution 


13 31 173 187 463 
t) = y,(t) Int — ( 327 t* a 1° t! ae ed © 
yo(t) = yi(t)In ( oh oar Pane aon’ Guang 


< 


Since the roots in this example are coincident, their difference is 0. The juncture 
mentioned in the example that proceeded this one thus occurs at n = 0 and so we 
can make the choice cp = 0. If co is chosen to be nonzero, then y> will include an 
extra term co y;. Thus nothing is gained. 


Example 8 (Complex Roots). Use Theorem 2 to solve the following differential 
equation: 


(t+ Dy” +ty’ +(¢+1)y =0. (27) 


> Solution. It is easy to see that ft = 0 is a regular singular point. The indicial 
polynomial is g(s) = s(s — 1) +s +1 =s? +1 and has roots r = +i. Thus, there 
is a complex-valued Frobenius solution, and its real and imaginary parts will be two 
linear independent solutions to (27). A straightforward substitution gives 


(oe) 


ry =t" Cr = 1)(n a= 2)Cn—1t", 


n=1 


~ 
~ 
| 

~ 


Co 
=f" Yia t+r)(a+r—e,t", 


n=0 


CO 
ty’ = 7 Yia +r)cnt", 


n=0 


lo) 
y= t" Sor 


n=0 
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lo) 
a= Tt ae 


n=1 


ioe) 
307 y =?" > 3c,—at”. 


n=2 


As usual, the sum of these series is zero. Since the index of the sums have different 
starting points, we separate the casesn = 0,n = 1,n = 2, andn => 3 to get, after 
some simplification, the following: 


n=0 (r? + 1)co = 0, 
n=1 ((r + 1)? + Dei + (r(r — 1) + 3)co = 0, 
n=2 (7 +2) + Deo + (rr + Ir + 3)c1 + 3c = 0, 
n>3 (r tn)y?+ Dent (er tn-—VDrtn—2) 4 3)en-1 
+ 3¢n—2 + Cn—3 = 0. 
The n = 0 case implies that r = +i. We will let r =i (the r = —i case will give 
equivalent results). As usual, co is arbitrary but nonzero. For simplicity, let us fix 


co = 1. Substituting these values into the cases,n = 1 andn = 2 above, gives 
cy =iandc = — The general recursion relation is 


(Gi + n) + len + (i + c= NG + n— 2) + 3)Cn-1 + 3Cn—2 + Cn-3 = 0 (28) 


from which we see that c, is determined as long as we know the previous three 
terms. Since co, cy, and cz are known, it follows that we can determine all c,’s. 
Although (28) is somewhat tedious to work with, straightforward calculations give 
the following values: 


n=0 co = 1, n=3 B= 3 =F: 

: 4 
n=1 cy = 1, n=4 c4= 3g = 4, 
_ _ -1 _ 2 _ a ok 
n=2 a= 7 = n=5 C5 = 199 = 5: 


Ll 


7n 
n° 


We will leave it as an exercise to verify by mathematical induction that c, = 
It follows now that 


cat i 
y(t) =t' Dae =e, 


n=0 
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ilnt and 


We assume f > 0. Therefore, we can write t' = e 
y(t) = ef tin), 
By Euler’s formula, the real and imaginary parts are 
y(t) =cos(t+Int) and y(t) = sin(t + Int). 
It is easy to see that these functions are linearly independent solutions. We remark 


that the r = —i case gives the solution y(t) = et!" , Its real and imaginary 
parts are, up to sign, the same as y; and y2 given above. <« 
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Exercises 


1-5. For each problem, determine the singular points. Classify them as regular or 
irregular. 


eee Pee 


2. y" + Sty! + Sety =0 

3. yp" +3t(1—t)y’ + ieey =0 
4, y" + ty’ + Sty =0 

5. ty” +(1—dy’ + 4ty =0 


6-10. Each differential equation has a regular singular point att = 0. Determine the 
indicial polynomial and the exponents of singularity. How many Frobenius solutions 
are guaranteed by Theorem 2? How many could there be? 


6. 2ty”+ y’+ty =0 

7. ty" + 2ty’+P?y =0 

8. ty" +te'y’ + 4(1—41t)y =0 

9. ty” +(1-t)y’+Ay =0 

10. t?7y” +3414 3t)y’ + —-2*)y = 0 

11-14. Verify the following claims that were made in the text. 

11. In Example 5, verify the claims that y,(t) = Sint and y(t) = SS, 


12. In Example 8, we claimed that the solution to the recursion relation 
(Gi =F n) Ss Yon ar (Gi i= IG -n= 2) =F 3)Cn-1 a 3Cn—2 a Cn-3 = 0 


was C, = r. Use mathematical induction to verify this claim. 


13. In Remark 3, we stated that the logarithmic case could be obtained by a 
reduction of order argument. Consider the Cauchy—Euler equation 


ty” + 5ty’+4y =0. 


One solution is y\(t) = t~?. Use reduction of order to show that a second 
independent solution is y(t) = t~* Int, in harmony with the statement for the 
appropriate case of the theorem. 


14. Verify the claim made in Example 6 that y;(t) = (t? + 4t7)e’ 


15-26. Use the Frobenius method to solve each of the following differential 
equations. For those problems marked with a (*), one of the independent solutions 
can easily be written in closed form. For those problems marked with a (**), both 


538 7 Power Series Methods 


independent solutions can easily be written in closed form. In each case below we 
let y = t" )-°°.y cnt” where we assume co # 0 and r is the exponent of singularity. 
15. ty”—2y'’+ty = 0 (**) (real roots, differ by integer, two Frobenius solutions) 


16. 2t7y” —ty’ + (1 + t)y = 0 (**) (real roots, do not differ by an integer, two 
Frobenius solutions) 


17. t?7y”—t(14+1t)y’ + y = 0, (*) (teal roots, coincident, logarithmic case) 


18. 2t7y” —ty’+ (1—t)y = 0 (**) (real roots, do not differ by an integer, two 
Frobenius solutions) 


19. t?y” + t?y’ — 2y = 0 (**) (real roots, differ by integer, two Frobenius 
solutions) 


20. t?y"” + 2ty’ — a*t?y = 0 (**) (real roots, differ by integer, two Frobenius 
Solutions) 


21. ty” + (t —1)y’ —2y = 0, (*) (real roots, differ by integer, logarithmic case) 
22. ty” — 4y = 0 (real roots, differ by an integer, logarithmic case) 
23. t7(-t + ly” + (tt +0?) y’ + (-2t + 1)y = 0 (**) (complex) 


24. t?y”+4(14 t)y’ —y = 0, (**) (real roots, differ by an integer, two Frobenius 
solutions) 


25. t?y” +¢(1 — 2t)y’ + (t? —t + 1l)y = 0 (**) (complex) 


26. (7(1+f)y” —t(1 + 2t)y’ + (14+ 2t)y = 0 (**) (real roots, equal, logarithmic 
case) 
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7.4 Application of the Frobenius Method: 
Laplace Inversion Involving Irreducible Quadratics 


In this section, we return to the question of determining formulas for the Laplace 
inversion of 
b s 
—————- and —~—._,, 
(s2 + b2)k+1 (s2 + b2)k+1 


for k a nonnegative integer. Recall that in Sect. 2.5, we developed reduction of order 
formulas so that each inversion could be recursively computed. In this section, we 
will derive a closed formula for the inversion by solving a distinguished second 
order differential equation, with a regular singular point at t = 0, associated to each 
simple rational function given above. Table 7.1 of Sect. 7.5 summarizes the Laplace 
transform formulas we obtain in this section. 

To begin with, we use the dilatation principle to reduce the simple quadratic 
rational functions given in (1) to the case b = 1. Recall the dilation principle, 
Theorem 23 of Sect.2.2. For an input function f(t) and b a positive number, we 
have 


(1) 


LIF} (8) = FLEFOH 8/b). 
The corresponding inversion formula gives 
£-1 £F(6/b} = bf), (2) 
where as usual £{ f} = F. 


Proposition 1. Suppose b > 0. Then 


= b — 1 
Z atceaaa (0) = pF ool (bt), 
Ss 


_ fs) We es 
Capa O= ee ag pA] 


Proof. We simply apply (2) to get 


-l 


bg 1 

laa} = pe ope} O 
Lat 1 

2k (s2 + Waal 


A similar calculation holds for the second simple rational function. Oo 


(bt). 


It follows from Proposition | that we only need to consider the cases 


s 1 
(2 + DI ane (s2 + DT (3) 
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We now define A;(t) and B;(t) as follows: 


+ 


— 9k =1 1 
Ax(t) = 2*KIL roe: ae 


By (t) = 2* kc! 


e 


Ss 
(s2 + 1)k+ ; 
The factor 2" k! will make the resulting formulas a little simpler. 
Lemma 2. Fork > 1, we have 
Ax(t) = —t?7 Ag—2(t) + (2k — DAg-1(1), k= 2, 
By(t) = tAx-i1(0), 
Ax (0) = 0, 
B,(0) = 0. 


(4) 


(5) 
(6) 
(7) 
(8) 


Proof. Let b = 1 in Proposition 8 of Sect. 2.5, use the definition of A, and B;,, and 


simplify to get 
Ax(t) = —tBe—-1(t) + (2k — 1)Ag-i (8), 
By(t) = tAg-i(t). 


Equation (6) is the second of the two above. Now replace k by k — 1 in (6) and 
substitute into the first equation above to get (5). By the initial value theorem, 


Theorem 1 of Sect. 5.4, we have 


Ss 
A, (0) = = a k! Jim oo (52 + 1)Ftt = 0, 
g2 
B,(0) = = i k! Jim ea ee = 0. 


Proposition 3. Suppose k > 1. Then 


A, (t) = By(t), 
By(t) = 2k Ag—1(t) — Ag(t). 


Proof. By the input derivative principle and the Lemma above, we have 


LA} (sL{Ax(t)} — Ax (0)) 


s 
~ (52 4 1)k+1 


1 
2K! aE 


= seg l BuO}. 


(10) 
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Equation (9) now follows. In a similar way, we have 


1 


1 
aR {Bi (t)} = Fg SE (BK (O} — B,(0)) 


s2 


1 1 
(s2 + 1)F (9? + 1H 
2k 1 


= ake Ara O} ~ FRR 


Li{Ax(t)}. 


Equation (10) now follows. oO 
Proposition 4. With notation as above, we have 
tAy —2kAj, + tAx = 0, (11) 
t? Bl —2ktBy + (t? + 2k) By = 0. (12) 
Proof. We first differentiate equation (9) and then substitute in (10) to get 
L = By = 2kAg—1 — Ak. 
Now multiply this equation by ¢ and simplify using (6) and (9) to get 


tA! = 2ktAp—; —tAy = 2k By, —tAp = 2k Ai, — tA. 


Equation (11) now follows. To derive equation (12), first differentiate equation (11) 
and then multiply by ¢ to get 


Al + (1—2k)taAl + t7A, + tAy = 0. 
From (11), we get tA, = —tAi/+2k Aj, which we substitute into the equation above 
to get 
tA!’ — 2kt Al + (t? + 2k) A, = 0. 
Equation (12) follows now from (9). oO 


Proposition 4 tells us that A, and B, both satisfy differential equations with a 
regular singular point at fy = 0. We know from Corollary 11 of Sect.2.5 that Ax 
and B, are sums of products of polynomials with sint and cost (see Table 2.5 for 
the cases k = 0,1, 2,3). Specifically, we can write 


Ax(t) = pi(t) cost + po(t) sint, (13) 
Bx(t) = qi(t) cost + qo(t) sint, (14) 
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where Pp}, P2, G1, and qz are polynomials of degree at most k. Because of the 
presence of the sin and cos functions, the Frobenius method will produce rather 
complicated power series and it will be very difficult to recognize these polynomial 
factors. Let us introduce a simplifying feature that gets to the heart of the polynomial 
coefficients. We will again assume some familiarity of complex number arithmetic. 
By Euler’s formula, e/’ = cost + isin¢ and e~" = cost —isint. Adding these 
formulas together and dividing by 2 gives a formula for cost. Similarly, subtracting 
these formula and dividing by 27 gives a formula for sint. Specifically, we get 


et + eit 

cost = ————— 
2 

elf — eit 

sint = ——_——_ 
2i 


Substituting these formulas into (13) and simplifying gives 


Ax (t) = p(t) cost + po(t) sint 


et + eit it —it 


e’—e 
= pit ——_ 
pilt) 5 + pr(t) i 
_ PD IPD oi 4 PUD PAO 


ak(t) i, , a(t), 
, a 
Re(ax(t)e"), 


II 


where a, (t) = p\(t) —ip2(t) is a complex-valued polynomial, which we determine 
below. Observe that since p; and p2 have degrees at most k, it follows that a, (t) is 
a polynomial of degree at most k. In a similar way, we can write 


By(t) = Re(di(t)e"), 


for some complex-valued polynomial b;(t) whose degree is at most k. We 
summarize the discussion above for easy reference. 


Proposition 5. There are complex-valued polynomials a;,(t) and b,(t) so that 


Ax(t) = Re(ax(t)e""), 
B,(t) = Re(b; (t)e!’). 


We now proceed to show that a;(t) and b;(t) satisfy second order differential 
equations with a regular singular point at f9 = 0. The Frobenius method will give 
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only one polynomial solution in each case, which we identify with a;,(t) and b;(t). 
From there, it is an easy matter to use Proposition 5 to find A, (t) and B,(t). 
First a little Lemma. 


Lemma 6. Suppose p(t) is a complex-valued polynomial and Re(p(t)e'") = 0 for 
allt € R. Then p(t) = 0 for allt. 


Proof. Write p(t) = a(t)+iB(t), where a(t) and 6(t) are real-valued polynomials. 
Then the assumption that Re(p(t)e!’) = 0 becomes 


a(t)cost — B(t)sint = 0. (15) 


Let f = 27n in (15). Then we get a(27n) = 0 for each integer n. This means 
a(t) has infinitely many roots, and this can only happen when a polynomial is zero. 
Similarly, if t = % + 2zrn is substituted into 15, then we get B (F + 2xn) = 0, 
for all n. We similarly get B(t) = 0. It now follows that p(t) = 0. Oo 


Proposition 7. The polynomials ax(t) and b;(t) satisfy 
tay + 2(it —k)a;, — 2kiax = 0, 
t?by + 2t(it — k)b, — 2k(it — by = 0. 


Proof. Let us start with A,. Since differentiation respects the real and imaginary 
parts of complex-valued functions, we have 


Ag(t) = Re(ag(t)e"), 
w(t) = Re((ax(t)e'')’) = Re((aj(t) + iax(1))e"'), 
K(t) = Re((ax(t) + 2iaj,(t) — ax(t))e""). 
It follows now from Proposition 4 that 
0 = tA (t) — 2kA;,(t) + tA (t) 
= t Re(ag(t)e!")” — 2k Re(a,(t)e!’)’ + t Re(ax (t)e"’) 
= Re((t(a/(t) + 2ia,(t) — ax (t)) — 2k (ay (t) + iax(t)) + tag (t))e"") 
= Re ((taf(t) + 2(it — k)aj,(t) — 2kia,(t))e""). 
Now, Lemma 6 implies 


tay (t) + 2(it — k)a;,(t) — 2kia,g(t) = 0. 


The differential equation in bg is done similarly and left as an exercise (see 
Exercise 3). oO 
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Each differential equation involving a, and b, in Proposition 7 is second order 
and has fg = 0 as a regular singular point. Do not be troubled by the presence of 
complex coefficients; the Frobenius method applies over the complex numbers as 
well. 

The following lemma will be useful in determining the coefficient needed in the 
Frobenius solutions given below for a; (t) and b,(t). 


Lemma 8. The constant coefficient of ax (t) is given by 


2k)! 
ax(0) = —i — 


The coefficient of t in by is given by 


, Q(k—1))! 
‘(ke —D2ED 


bi (0) = — 
Proof. Replace k by k + 2 in (5) to get 
Ag+2 = (2k + 3)Agyi — 07 Ak, 
for all t and k > 1. Lemma 6 gives that a; satisfies the same recursion relation: 
ax+a(t) = (2k + 3)ac4i (0) — tax (0). 
If t = 0, we get ap42(0) = (2k + 3)ax+1(0). Replace k by k — 1 to get 


ax41(0) = (2k + Ia; (0). 


By Table 2.5, we have 
A) =2aye"| | 
: (s? + 1)? 
= sint —tcost 
= Re((—t —i)e’’). 
Thus, a;(t) = —t —i and a,(0) = —i. The above recursion relation gives the 
following first four terms: 
a,(0) = —i, a3(0) = 5a2(0) = —5-3-i, 
a2(0) = 3a,(0) = —3i, a4(0) = 7a3(0) = —7-5-3-i. 
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Inductively, we get 


a0) == = 1) ERB) xg 94 
(2k)! 
aaa 


For any polynomial p(t), the coefficient of ¢ is given by p’(0). Thus, 5, (0) is the 
coefficient of ¢ in b;(t). On the other hand, (6) implies b,+41(t) = ta, (t), and hence, 
the coefficient of ¢ in b,+1(t) is the same as the constant coefficient, a; (0) of a,(t). 
Replacing & by k — 1 and using the formula for a; (0) derived above, we get 


2(k — 1))! 
bj (0) = ax—1 (0) = SF eee ‘ 


Proposition 9. With the notation as above, we have 


(2k sia 
a(t) = 2k oe mo si 


k-1 
—it (2(k — 1) —n)! 
and bx (t) = Qk-1 amr! n\(k —1-n)! 


(—2it)”. 


Proof. By Proposition 7, a; (t) is the polynomial solution to the differential equation 
ty” + 2(it —k)y’ —2kiy =0 (16) 


with constant coefficient a, (0) as given in Lemma 8. Multiplying equation (16) 
by t gives t7y” + 2t(it —k)y’ — 2kity = 0 which is easily seen to have a regular 
singular point at ¢ = 0. The indicial polynomial is given by g(s) = s(s—1)—2ks = 
s(s — (2k + 1)). It follows that the exponents of singularity are 0 and 2k + 1. We 
will show below that the r = 0 case gives a polynomial solution. We leave it to the 
exercises (see Exercise 1) to verify that the r = 2k + 1 case gives a nonpolynomial 


Frobenius solution. We thus let 


[oe 
y(t) = s Cyt”. 


n=0 


Then 


ty"(t) = SO @ at VDensit”, 


n=1 


le.) 
2ity'(t) = D> 2inent”, 


n=1 


546 7 Power Series Methods 


oe) 


—2ky'(t) = S> 2k + VYensit”, 
n=0 


CO 


—2iky(t) = ) > —2ikent”. 


n=0 


By assumption, the sum of the series is zero. We separate the n = 0 andn > 1 cases 
and simplify to get 


n=O —2kc; —2ikco = 0, 


n>1 (n — 2k)(n + VW en41 + 2i(n —k)cy = 0. (17) 
The n = O case tells us that c} = —icg. For 1 <n < 2k — 1, we have 
—2i(k —n) 
Cnh+1 = 


(2k —n)(n + ih 


Observe that c,4,; = 0, and hence, c, = 0 for allk +1 <n < 2k —1. For 
n = 2k we get from the recursion relation 0c2,.41; = 2ikc, = 0. This implies that 
Cox4+1 can be arbitrary. We will choose c2,41; = 0. Then c, = 0 for alln > k +1, 
and hence, the solution y is a polynomial. We make the usual comment that if c,+4 
is chosen to be nonzero, then those terms with c,+; as a factor will make up the 
Frobenius solution for exponent of singularity r = 2k + 1. Let us now determine 
the coefficients c, for 0 <n <k. From the recursion relation, (17), we get 


n=0 Cc; =—ICo, 
pel ge ED, @ ACPD 21)? KK =D) 
mero) eh ae Qk=D2 " CHCF=1)2 
—ik=2) (—21)°k(k — 1)(k —2) 
n= 2 = OE D3 = TOK — Dok —D3t 
—2i(k-—3) _ (-2i) 4k — Ik — 2) - 3) 


0. 


Co. 


and generally, 


_ (-2i)"k(k — 1) (kK-n +1) 


n — =1,...,k. 
on 2kOK —1)---Ok—n+ Tat ° ” 


We can write this more compactly in terms of binomial coefficients as 
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It follows now that 


2 n 
=a re) 5 Oo 


n=0 ee 


The constant coefficient is cp. Thus, we choose co = ax (0) as given in Lemma 8. 
Then y(t) = a(t) is the polynomial solution we seek. We get 


eouer 
ax(t) = ax(0) tt" 
. . erty Cr)n! 


_ > (2k)! (-28") 


7 n=0 RE Cn 


k 
_ = (2k —n)! , 
7 n=0 (k — nin . ™ = 


It is easy to check that (6) has as an analogue the equation by+i(t) = tax(t). 
Replacing k by k — 1 in the formula for a;(t) and multiplying by ¢ thus establishes 
the formula for b; (t). Oo 


For x € R, we let |x| denote the greatest integer function of x. It is defined to 
be the greatest integer less than or equal to x. We are now in a position to give a 
closed formula for the inverse Laplace transforms of the simple rational functions 
given in (4). 


Theorem 10. For the simple rational functions, we have 


wy = LJ cy" (* ral (21)?" 


22k k (2m)! 


m=0 


Clara 
(s2 + 1)k+1 


Ls] 2m+1 
cost m[ 2k —2m—1)\ (2¢) 
D2 ie ( k ea 


m=0 


(t)= 


—1 
2t sint nem a ma 2k —2m —2\ (2t)?”" 
Ree Le k-1 | Qmy! 


=| S 
L (s2 + aar| 


__ 2t cost ye ty" 2k —2m—3) (2t)?"7! 
~ Dk k-1 |Qm+)! 


m=0 


The first formula is valid for k > 0, and the second formula is valid fork > 1. Sums 
where the upper limit is less than 0 (which occur in the cases k = 0 and 1) should 
be understood to be 0. 
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Proof. From Proposition 9, we can write 


2k 
ay(t) = = SE >? ee oC Ly Gy Ory. 


It is easy to see that the real part of a, consists of those terms where n is odd. 
The imaginary part consists of those terms where n is even. The odd integers from 
n = 0,...,k can be written n = 2m + 1 where m = 0,..., [s+]. Similarly, the 
even integers can be writtenn = 2m, wherem = 0,..., LEI. We thus have 


— 2k — 2m —1)! 
Re(ax(t)) = Xu ans ris —_ pierre Panent 


=i 5 (2k —2m— 1)! Cayman! 


2k 2+ (2m + 1)'(k — 2m —1)! 
and 
I = (2k — 2m)! Ly2F1 jp y2mtL eg py2m 
m(ak(t)) = pe L Gaye — Im” OMEN 


—1 


= (2k —2m)! errr 
7 yee ees 


Now Re(az(t)e!”) = Re(ag(t)) cost — Im(a;(t)) sint. It follows from Proposi- 
tions 5 that 


Re(a;(t)e"’) 


1 1 
ie = 
(s2 4 val 2K! 


Re(a;(t)) cost — Im(a;(t)) sint 


= aE 


(-1)"(22)?""! 


[E1 
_ —cost =p (2k —2m—1)! 
kim + Dik —2m—1)! 


gu (2k —2m)! mem vam 
+ Dik eee 1)"(2t) 
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—cost va! 2k —2m—1 (2r)7""! 

= x (—1)”" ———_ 
22k ra k (2m + 1)! 
sint 2k —2m 2t)2" 

+ (—1)” ( ) : 
Qk ae k (2m)! 
A similar calculation gives the formula for £7! { GG ra FI \ oO 


We conclude with the following corollary which is immediate from 
Proposition 1. 


Corollary 11. Let b > 0, then 


[5 | 
LS] 


z b _ sinbt 2k — 2m \ (2bt)?" 
fe ae} © = (by - py ( i = 


cos bt 


Ls") 
m{ 2k —2m—1)\ bt)?"41 
~ (2b) Xu CD ( k oe 


LF 
-1 s _ 2bt sin bt im {2k — 2m — 2\ (2b1)*" 
L reeso al (t) = k - (2b) “3 (-1) ( ee Om)! 


2bt cos bt 


a { 2k — 2m — 3\ (2bt)2"*! 
~ + (2b) ye _ o =i oe 
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7.4 Laplace Inversion Involving Irreducible Quadratics 551 
Exercises 


1-3. Verify the following unproven statements made in this section. 
1. Verify the statement made that the Frobenius solution to 
ty” + 2(it —k)y’ —2kiy =0 


with exponent of singularity r = 2k + 1 is not a polynomial. 
2. Verify the second inversion formula 


= Ss 
L (s2 + ar} (t i= = go" (s2 4 =} (bt) 


given in Proposition 1. 
3. Verify the second differential equation formula 


“bt + 2t(it —k)bi — 2k(it — 1), = 0 


given in Proposition 7. 


4-15. This series of exercises leads to closed formulas for the inverse Laplace 
transform of 


1 RY 
(s2 — 1)k+1 and (s2 — 1)k+1" 


Define C(t) and D,(t) by the formulas 


sal (el) (s) = @_-pe 


and 


ail (Pel) (s) = (2-1) 


4. Show that C; and Dy, are related by 
Dx+i(t) = tC, (t). 


5. Show that C;, and D, satisfy the recursion formula 


Cx (t) = tDg—1(t) — (2k — 1)Cx-1 (0). 
6. Show that C;, satisfies the recursion formula 


Cyso(t) = t?Cx(t) — (2k + 3)Ce4i@). 
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7. Show that D; satisfies the recursion formula 
Dyso(t) = 0? Dy (t) — (2k + 1) Deri). 
8. Fork > 1, show that 
Cx (0) = 0, 
D,(0) = 0. 
9. Show that for k > 1, 
1. Ci(t) = Dx(t). 
2. Di (t) = 2kCg-1(t) + Cx (t). 
10. Show the following: 
1. t/t) — 2kC{(t) — ty (t) = 0. 
2. t? Di (t) — 2ktD),(t) + (2k — 17) Dx (t) = 0. 


11. Show that there are polynomials c; (t) and d;(t), each of degree at most k, such 
that 


1. Cy(t) = cg (t)e’ — ex (—t)e™. 

2. Dg(t) = dk (the’ + dy (te. 
12. Show the following: 

1. tcf (t) + (2t — 2k)c;(t) — 2ke,(t) = 0. 

2. td (t) + 2t(t —k)di(t) — 2k(t — 1)dx(t) = 0. 
13. Show the following: 


—1) (2k)! 
1 = Sieg 
(12K - 1p! 
2. di(0) = 


2k(k — 1)! 
14. Show the following: 


(1) 4 (2k =n)! 


1 a® = Serr Lu aie —n)! 
n=0 


(—2t)”. 


Cp’ 3s Ok =n = 15! 


2. dk(t) = Qk+1 = (n— I)M(k —n)! 


(—2t)”. 
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15. Show the following: 


= 1 (—1)* (2k — 
Lee roesvaat () = D+ KY » 4“ ni(k — 


n 


~ 


1)! 


AY 
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((—21)"e' — (2t)"e). 


((—2t)"e' + (2t)"e*). 


7 ( 1)* . (2k 
2.£ ~ D2k+1 KI ve —1) 


(s2 = 1)k+1 


Wk — 


n)! 
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7.5 Summary of Laplace Transforms 


7.5 Summary of Laplace Transforms 


555 


Table 7.1 Laplace transforms 


f(t) 
Laplace transforms involving the quadratic s? + b? 
é 
sinbt La! — ym (2bt)2” 
: 2k » Core : ) 1 
(2b) m=0 (2m)! 
cos bt — (-1)” (eae) eye 
(2b) m=0 c (2m + 1)! 
2bt sin bt Lz] (2bt)2" 
2 yn 2k—2m—2 
 ByF ey OV Gt 


k=2 
2bt cos bt [=] siibanan sian 
k - (2b)* | yO =T ) GnEnr 


Laplace transforms involving the quadratic s? — b? 


(Ik # @k=n 
" DKF KY jy n(k —n)! 


(-1lk £& (Qk—n-—-1)! 


4, 
PEAVEY =) (n — 1k — 1)! 


JY (-28V"e! = Q4y"e~) 


((—2r)"e" + (2t)"e") 


F(s) 


b 


(s2 + b2)k+1 


S 


(s? + b2)k+1 
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Chapter 8 
Matrices 


Most students by now have been exposed to the language of matrices. They arise 
naturally in many subject areas but mainly in the context of solving a simultaneous 
system of linear equations. In this chapter, we will give a review of matrices, systems 
of linear equations, inverses, determinants, and eigenvectors and eigenvalues. The 
next chapter will apply what is learned here to linear systems of differential 
equations. 
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8.1 Matrix Operations 559 
8.1 Matrix Operations 


A matrix is a rectangular array of entities and is generally written in the following 
way: 


Xi tt* Xin 


Xm +++ Xmn 


We let R denote the set of entities that will be in use at any particular time. Each x;; 
is in F, and in this text, R can be one of the following sets: 


RorC The scalars 

R[{t] or C[¢] Polynomials with real or complex entries 
R(s) or C(s) The real or complex rational functions 
C¥(,R) or C¥(I,C) Real- or complex-valued functions 


with k continuous derivatives 


Notice that addition and multiplication are defined on . Below we will extend 
these operations to matrices. 
The following are examples of matrices. 


Example 1. 


; KY 1 
sint a ot 
se—] se— 
D= t|, E= 
a <t eo 
tan ¢ 


s2—1 s?-1 


It is a common practice to use capital letters, like A, B, C, D, and E, to denote 
matrices. The size of a matrix is determined by the number of rows m and the 
number of columns n and written m xn. In Example 1, A isa2x3 matrix, B isa 1x3 
matrix, C and E are 2x2 matrices, and D isa 3x1 matrix. A matrix is square if the 
number of rows is the same as the number of columns. Thus, C and EF are square 
matrices. An entry in a matrix is determined by its position. If X is a matrix, the 
(i, 7) entry is the entry that appears in the ith row and jth column. We denote it in 
two ways: ent;;(X) or more simply X;;. Thus, in Example 1, A;3 = 3, Bj2g = —1, 
and Cy. = 0. We say that two matrices X and Y are equal if the corresponding 
entries are equal, that is, X; ; = Y; ;, for all indices i and j. Necessarily, X and Y 
must be the same size. The main diagonal of a square n x n matrix X is the vector 
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formed from the entries X;;, fori = 1,...,m. The main diagonal of C is (7,0) and 
the main diagonal of E is (>, st). A matrix is said to be a real matrix if each 
entry is real and a complex matrix if each entry is complex. Since every real number 
is also complex, every real matrix is also a complex matrix. Thus, A and B are real 
(and complex) matrices while C is a complex matrix. 

Even though a matrix is a structured array of entities in 7, it should be viewed as 
a single object just as a word is a single object though made up of many letters. We 
let Min.n(R) denote the set of all m x n matrices with entries in 7. If the focus is 
on matrices of a certain size and not on the entries, we will sometimes write My». 
The following definitions highlight various kinds of matrices that commonly arise: 


1. A diagonal matrix D is a square matrix in which all entries off the main diagonal 
are 0. We can say this in another way: 


D;; =Oifi # j. 


Examples of diagonal matrices are: 


1 
- 00 0 
e 00 2D 
10 0 0 0 
(4 0 e* 0 s-l 
0 01 0 00 ee 
0 00 
s—2 
It is convenient to write diag(d,,...,d,,) to represent the diagonal n x n matrix 
with (d,,...,d,) on the diagonal. Thus, the diagonal matrices listed above are 


diag(1, 4), diag(e’, e’, 1), and diag(+, 4. 0, —+4). respectively. 

2. The zero matrix 0 is the matrix with each entry 0. The size is usually determined 
by the context. If we need to be specific, we will write 0,,,, to mean the m xn zero 
matrix. Note that the square zero matrix, 0,,,, is diagonal and is diag(0,..., 0). 

3. The identity matrix, I, is the square matrix with ones on the main diagonal and 
zeros elsewhere. The size is usually determined by the context, but if we want to 
be specific, we write J,, to denote the n x n identity matrix. The 2 x 2 and the 


3 x 3 identity matrices are 


ine 100 
n=| |: Ih= 010 


001 


4. We say a square matrix is upper triangular if each entry below the main diagonal 
is zero. We say a square matrix is lower triangular if each entry above the main 
diagonal is zero. The matrices 
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13 5 
and 00 3 
00 -—4 


are upper triangular, and 


00 O 
and 20 0 
11-7 


are lower triangular. 


5. Suppose A is an m Xx n matrix. The transpose of A, denoted A’, is the n x m 


matrix obtained by turning the rows of A into columns. In terms of the entries 
we have, more explicitly, 


(A); 7 = Aji. 


This expression reverses the indices of A. Simple examples are 


23 / : Fe]! 1 2 

ee 291 e’ 2 E ] Cin (ieee ee rs 

304 e! 2 3 2 3 

i srs sos 
Matrix Algebra 


There are three matrix operations that make up the algebraic structure of matrices: 
addition, scalar multiplication, and matrix multiplication. 


Addition 


Suppose A and B are two matrices of the same size. We define matrix addition, 
A+ B, entrywise by the following formula: 


(A+ B); ; = Ai; + Bij. 


1 —2 4-1 
A= s and B = 0 ; 
4 5-3 —3 81 


Thus, if 
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14+4-2-1 0+0 5-3 0 
A+B= = ; 
4—3 54+8-3+1 1 13 —2 
Corresponding entries are added. Addition preserves the size of matrices. We can 
symbolize this in the following way: 


then 


Te Mun(R) x Minn (R) Ed Mmnn(R). 


Addition satisfies the following properties: 


Proposition 2. Suppose A, B, and C are m x n matrices. Then 


A+B=B+A4, (commutative) 
(A+B)+C=A+(B4+0CO), (associative) 
A+0=A4, (additive identity) 
A+ (—A) = 0. (additive inverse) 


Scalar Multiplication 


Suppose A is an matrix and c € R. We define scalar multiplication, c - A, (but 
usually we will just write cA), entrywise by the following formula 


(cA); ; = cA; ;. 
For example, 
19 —2 -18 
—2)-3 0) = 6 0 
25 —4 —10 


Scalar multiplication preserves the size of matrices. Thus, 
“DRX Munn(R) > Mna(R). 


Scalar multiplication satisfies the following properties: 
Proposition 3. Suppose A and B are matrices of the same size. Suppose C,, C2 € R. 
Then 
c\(A+ B)=c}A4+cB, (distributive) 
(cy +02)A = cCyA+ OA, (distributive) 
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Ci(C2A) = (cic2)A, (associative) 
1A=A, (1 is a multiplicative identity) 
0OA=0. 


Matrix Multiplication 


Matrix multiplication is more complicated than addition and scalar multiplication. 
We will define it in two stages: first on row and column matrices and then on general 
matrices. 

A row matrix or row vector is a matrix which has only one row. Thus, row vectors 
are in M,,,. Similarly, a column matrix or column vector is a matrix which has only 
one column. Thus, column vectors are in M,,;. We frequently will denote column 
and row vectors by lower case boldface letters like v or x instead of capital letters. 
It is unnecessary to use double subscripts to indicate the entries of a row or column 
matrix: if v is a row vector, then we write v; for the ith entry instead of v,;. Similarly 
for column vectors. Suppose v € M,,, and w € M,,1. We define the product v - w 
(or preferably vw) to be the scalar given by 


VW = Vw tees + VW. 
Even though this formula looks like the scalar product or dot product that you likely 


have seen before, keep in mind that v is a row vector while w is a column vector. 
For example, if 


v=|1 3 2 o| and w = 


Co OW 


then 
vw = 1-1+3-3+4+ (-2)-0+0-9= 10. 


Now suppose that A is any matrix. It is often convenient to distinguish the rows 
of A in the following way. Let Row; (A) denotes the ith row of A. Then 


| Row (4)] 
Row2(A) 


Row; (A) 


In a similar way, if B is another matrix, we can distinguish the columns of B. Let 
Col; (B) denote the jth column of B, then 
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B = [Col\(B) Cok,(B) -- Col,(B)]. 


Now let A € M,,, and B € M,,». We define the matrix product of A and B to 
be the m x p matrix given entrywise by ent; ;(AB) = Row;(A) Col; (B). In other 
words, the (7, 7)-entry of the product of A and B is the ith row of A times the jth 
column of B. We thus have 


| Row; (A) Col,(B) Row,(A) Coh(B) --- Row;(A) Col,(B) 


ies: Row (A) Col;(B) Row2(A) Col(B) --- Row2(A) Col,(B) 


Row, (A) Col;(B) Rowm(A) Col(B) +++ Row, (A) Col,(B) 
Notice that each entry of AB is given as a product of a row vector and a column 
vector. Thus, it is necessary that the number of columns of A (the first matrix) 
match the number of rows of B (the second matrix). This common number is n. 
The resulting product is an m x p matrix. We thus write 


© Minn (R) X Mi p(R) > Mmn,p(R). 


In terms of the entries of A and B, we have 


ent; ;(AB) = Row;(A) Col;(B) = Sent ¢(A)enty j (B) = a Aj « Bx,j. 
k=1 


k=1 
Example 4. 
2 1 ae 
1.IfA=j]-1 3]andB= | then AB is defined because the number of 
a 
4-2 


columns of A is the number of rows of B. Further, AB is a3 x 2 matrix and 


[21] | [21] a 
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te! —2 
SA OO and BS then 
e2! 302! 1 
AR = —2e! + 2e! 7 0 . 
—2e7! + 3e2! e2! 


Notice in the definition (and the example) that in a given column of AB, the 
corresponding column of B appears as the second factor. Thus, 


Col; (AB) = ACol;(B). (1) 
Similarly, in each row of AB, the corresponding row of A appears and we get 
Row; (A)B = Row; (AB). (2) 


Notice too that even though the product AB is defined, it is not necessarily true 
that BA is defined. This is the case in part 1 of the above example due to the fact 
that the number of columns of B (2) does not match the number of rows of A (3). 
Even when AB and BA are defined, it is not necessarily true that they are equal. 
Consider the following example: 


Example 5. Suppose 


Then 


while 


LE JE-ET 


These products are not the same. This example shows that matrix multiplication is 
not commutative. On the other hand, there can be two special matrices A and B for 
which AB = BA. In this case, we say A and B commute. For example, if 


1-1 11 
A= and B = , 
1 1 -11 
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AB= ae = BA, 
02 


Thus A and B commute. However, such occurrences are special. The other 
properties that we are used to in an algebra are valid. We summarize them in the 
following proposition. 


then 


Proposition 6. Suppose A, B, and C are matrices whose sizes are such that each 
line below is defined. Suppose C1, C2 € R. Then 


A(BC) = (AB)C, (associatvie) 
A(cB) = (cA)B = c(AB), (commutes with scalar multiplication) 
(A+ B)C = AC+ BC, (distributive) 
A(B+C)=AB+AC, (distributive) 
IA=AI=A. (J is a multiplicative identity) 


We highlight two useful formulas that follow from these algebraic properties. If 
Aisanm Xn matrix, then 


Ax = x; Col;(A) +---x, Col,(A), | where x = (3) 


and 
yA = y,Row;(A) +--+ ¥mRowm(A), wherey = [y1--- Ym - (4) 


Henceforth, we will use these algebraic properties without explicit reference. The 
following result expresses the relationship between multiplication and transposition 
of matrices 


Theorem 7. Let A and B be matrices such that AB is defined. Then B' A' is defined 
and 


BA’ = (ABY'. 


Proof. The number of columns of B’ is the same as the number of rows of B while 
the number of rows of A’ is the number of columns of A. These numbers agree since 
AB is defined so B' A’ is defined. If n denotes these common numbers, then 


(BA); = SO(BY:AD« = So Aja Bei = (AB);; = ((AB)’); ;. 
k=1 k=1 


All entries of A‘ B’ and (AB)’ agree so they are equal. Oo 
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Exercises 


1-1 02 
2-13 
1-3. Let A = ‘i ‘| B= 2 3], andC = |} —3 4]. Compute the 
-1 2 11 


following matrices. 


i. BEC, B=C, 2R=3C 
2. AB, AC, BA, CA 
3. A(B+C), AB+AC, (B+C)A 


21 12 
4. LettA = 34] and B = | —-1 1 |. FindC sothat3A4+C = 4B. 
-10 10 
a 15 
—s e114 34 
5-9.Let A = 10-2], B = “~T and C = . Find the 
6-141 018 
i) 2 
is 
following products. 
5. AB 
6. BC 
7. CA 
8. BYAt 
9. ABC 
1 
oO] _. 
10. LetA= [1 43 1] and B= |_| |. Find AB and BA. 
) 
ses 1 0 5 
11-13.LetA = | 2 410], B= , C = |> “|. Verify the 
f= 4 ea) 


following facts: 
11. A7=0 
12. BP=h 
13.0 =< 
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14-15. Compute AB — BA in each of the following cases. 


14. A= i | B= 
11 11 


210 3 1-2 
15. A= 111], B= 3-2 4 
-121 —3 5-1 
la 10 
16. Let A = and B = . Show that there are no numbers a and b so 


that AB — BA = I, where J is the 2 x 2 identity matrix. 
17. Suppose that A and B are 2 x 2 matrices. 


1. Show by example that it need not be true that (A + By = A24+2AB + B?. 
2. Find conditions on A and B to insure that the equation in Part (a) is valid. 


01 

18. If A= f i compute A? and A?. 
11 

19. If B= eit compute B” for all. 


0 
20. If A= |: a , compute A”, A>, and more generally, A” for all n. 


21. Let A =|" 
v2 
A is not relevant for this problem.) Describe the effect of multiplying A on the 


left by the following matrices: 


01 le 10 a0 10 
[Pe [eefo (i [es] @ [8] 


cos@ sin@ 


be a matrix with two rows v, and v2. (The number of columns of 


22. Let E(@) = } Show that E(@, + 02) = E(6,) E(62). 


—sin@ cos@ 
cosh@ sinh@ 
sinh 6 cosh@ 
24. Let D = diag(d,,...,d,) and E = diag(e,,...,e,). Show that 


23. Let F(@) = | Show that F(@, + 62) = F(@,) F(@2). 


DE = diag(d\e1, Senaes dnen). 
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8.2 Systems of Linear Equations 


Most students have learned various techniques for finding the solution of a 
system of linear equations. They usually include various forms of elimination and 
substitutions. In this section, we will learn the Gauss-Jordan elimination method. It 
is essentially a highly organized method involving elimination and substitution that 
always leads to the solution set. This general method has become the standard for 
solving systems. At first reading, it may seem to be a bit complicated because of its 
description for general systems. However, with a little practice on a few examples, 
it is quite easy to master. We will as usual begin with our definitions and proceed 
with examples to illustrate the needed concepts. To make matters a bit cleaner, we 
will stick to the case where R = R. Everything we do here will work for R = C, 
R(s), or C(s) as well. (A technical difficulty for general 7e is the lack of inverses.) 
If x1,...,X, are variables, then the equation 


A,X + +++ + AnXn = b 


is called a linear equation in the unknowns x1, ..., X,. A system of linear equations 
is a set of m linear equations in the unknowns x),...,X, and is written in the form 
Ay 1X1 + Ay2X_ tees + AinX, = dy 


d21X1 + d22X2 +++ + AanXn = bo 


(1) 


AmiX1 + Am2X2 + +++ + AnnXn = bm. 


The entries a; ; are in R and are called coefficients. Likewise, each b; is in R.A 
key observation is that (1) can be rewritten in matrix form as: 


Ax =b, (2) 
where 
Q11 Gi2°*** Ain x) by 
a2, d22*** Arn x2 by 
A= . «= ae x=] |, and b= 
QAm1 Gm2 *** Gmn Xn bin 


We call A the coefficient matrix, x the variable matrix, and b the output matrix. 
Any column vector x with entries in R that satisfies equation (1) (or, equivalently, 
equation (2)) is called a solution. If a system has a solution, we say it is consistent; 
otherwise, it is inconsistent. The solution set is the set of all solutions. The system 
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is said to be homogeneous if b = 0, otherwise it is called nonhomogeneous. The 
homogeneous case is especially important. We call the solution set to 


Ax = 0 


the null space of A and denote it by NS(A). Another important matrix associated 
with (2) is the augmented matrix: 


G11 di2°** Atn| 
a2, d22°*+ Arn| bo 
[A|b] = ss 


Am1 Am2 *** Amn bin 


where the vertical line only serves to separate A from b. 
Example 1. Write the coefficient, variable, output, and augmented matrices for the 
following system: 

—2x, + 3x. — x3 = 4 


X, — 2x. + 4x3 5. 


Determine whether the following vectors are solutions: 


—3 7 10 
Y= OO}, vW2a=/]7], V3=] 7], wf 
2 3 
> Solution. The coefficient matrix is A = if ; aA the variable matrix 
x) 
is xX = |x], the output matrix is b = :] , and the augmented matrix is 
x3 : 
ie ; 7 ‘| The system is nonhomogeneous. Notice that 


Avy = : and Av2 = ‘ while Av3 = ° ; 
5 5 0 


Therefore, v; and v2 are solutions, v3 is not a solution but since Av3 = 0, we have 
v3 is in the null space of A. Finally, v4 is not the right size and thus cannot be a 
solution. < 
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Remark 2. When only 2 or 3 variables are involved in an example, we will 
frequently use the variables x, y, and z instead of the subscripted variables x), x2, 
and x3. 


Linearity 


It is convenient to think of R” as the set of column vectors M,, | (IR). If A is anm xn 
real matrix, then for each column vector x € R", the product, Ax, is a column vector 
in R”. Thus, the matrix A induces a map which we also denote just by A : R” > R” 
given by matrix multiplication. It satisfies the following important property. 


Proposition 3. The map A : R" — R” is linear. In other words, 


1. A(x+ y) = A(x) + A(y) 
2. A(cx) = cA(x) 


for allx,y € R" andc €R. 
Proof. This follows directly from Propositions 3 and 6 of Sect. 8.1. oO 


Linearity is an extremely important property for it allows us to describe the 
structure of the solution set to Ax = b in a particularly nice way. 


Proposition 4. With A, x, and b as above, we have two possibilities. Either the 
solution set to Ax = b is the empty set or we can write all solutions in the following 
form: 

Xp + Xn, 


where X, is a fixed particular solution and Xp is any vector in NS(A). 


Remark 5. We will write the solution set to Ax = b, when it is nonempty, as 
Xp + NS(A). 


Proof. Suppose X, is a fixed particular solution and x, € NS(A). Then A(xX)+Xn) = 
AX, + AXn = b+ 0 = b. This implies that x, + xp is a solution. On the other hand, 
suppose x is a solution to Ax = b. Let x, = x — Xp. Then Axp = A(K— Xp) = 
Ax — Axp = b—b = O. This means that xp is in the null space of A and we get 
X = Xp + Xh. Oo 


Remark 6. The solution set being empty is a legitimate possibility. For example, 
the simple equation Ox = 1 has empty solution set. The system of equations 
Ax=0 is called the associated homogeneous system. It should be mentioned that the 
particular solution x, is not necessarily unique. In Chap. 5, we saw a similar theorem 
for a second order differential equation Ly = f. That theorem provided a strategy 
for solving such differential equations: First we solved the homogeneous equation 
Ly = 0 and second found a particular solution (using variation of parameters or 
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undetermined coefficients). For a linear system of equations, the matter is much 
simpler; the Gauss-Jordan method will give the whole solution set at one time. We 
will see that it has the above form. 


Homogeneous Systems 


The homogeneous case, Ax = 9, is of particular interest. Observe that x = 0 is 
always a solution so NS(A) is never the empty set. But much more is true. 


Proposition 7. The solution set, NS(A), to a homogeneous system Ax = 0 is a 
linear space. In other words, if x and y are solutions to the homogeneous system 
and c is a scalar, thenx + y and cx are also solutions. 


Proof. Suppose x and y are in NS(A). Then A(x+y) = Ax+ Ay = 0+ 0 = 0. This 
shows that x + y € NS(A). Now suppose c € R. Then A(cx) = cAx = c0 = 0. 
Hence cx € NS(A). Thus NS(A) is a linear space. Oo 


Corollary 8. The solution set to a general system of linear equations, Ax = b, is 
either 


1. Empty 
2. Unique 
3. Infinite 


Proof. The associated homogeneous system Ax = 0 has solution set, NS(A), that 
is either equal to the trivial set {0} or an infinite set. To see this suppose that x is a 
nonzero solution to Ax = 0, then by Proposition 7, all multiples, cx, are in NS(A) 
as well. Therefore, by Proposition 4, if there is a solution to Ax = b, it is unique or 
there are infinitely many. Oo 


The Elementary Equation and Row Operations 


We say that two systems of equations are equivalent if their solution sets are the 
same. This definition implies that the variable matrix is the same for each system. 


Example 9. Consider the following systems of equations: 


2x + 3y =5 x= 1 
x —-y =0 y=. 


The solution set to the second system is transparent. For the first system, there 
are some simple operations that easily lead to the solution: First, switch the two 
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equations around. Next, multiply the equation x — y = 1 by —2 and add the result 
to the second equation. We then obtain 


x— y 
5y = 5 


Next, multiply the second equation by i to get y = 1. Then add this equation to 
the first. We get x = 1 and y = 1. Thus, they both have the same solution set, 


1 
namely, the single vector ah They are thus equivalent. When used in the right 


way, these kinds of operations can transform a complicated system into a simpler 
one. We formalize these operations in the following definition: 

Suppose Ax = b is a given system of linear equations. The following three 
operations are called elementary equation operations: 


1. Switch the order in which two equations are listed. 
2. Multiply an equation by a nonzero scalar. 
3. Add a multiple of one equation to another. 


Notice that each operation produces a new system of linear equations but leaves 
the size of the system unchanged. Furthermore, we have the following proposition. 


Proposition 10. An elementary equation operation applied to a system of linear 
equations is an equivalent system of equations. 


Proof. Suppose S is a system of equations and S’ is a system obtained from S 
by switching two equations. A vector x is a solution to S if and only if it satisfies 
each equation in the system. If we switch the order of two of the equations, then x 
still satisfies each equation, and hence is a solution to S’. Notice that applying the 
same elementary equation operation to S’ produces S$. Hence, a solution to S’ is a 
solution to S. It follows that S and S’ are equivalent. The proof for the second and 
third elementary equation operations is similar. Oo 


The main idea in solving a system of linear equations is to perform a finite 
sequence of elementary equation operations to transform a system into simpler 
system where the solution set is transparent. Proposition 10 implies that the solution 
set of the simpler system is the same as original system. Let us consider our example 
above. 


Example 11. Use elementary equation operations to transform 
2x + 3y = 5, 
x -—-y=0 


into 
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> Solution. 


2x + 3y =5 Switch the order of the two equations. 
x —- y =0 
x —- y =0 Add —2 times the first equation to the 
2x + 3y =5 second equation. 
x-y =0 Multiply the second equation by i. 
Sy = 5 
x—-y=0 Add the second equation to the first. 
y = 
x =1 
y= A « 


Each operation produces a new system equivalent to the first by Proposition 
10. The end result is a system where the solution is transparent. Since y = 1 
is apparent in the fourth system, we could have stopped and used the method of 
back substitution, that is, substitute y = | into the first equation and solve for x. 
However, it is in accord with the Gauss—Jordan elimination method to continue as 
we did to eliminate the variable y in the first equation of the fourth system. 

You will notice that the variables x and y play no prominent role in any of 
the calculations. They merely serve as placeholders for the coefficients, some of 
which change with each operation. We thus simplify the notation by performing 
the elementary operations on just the augmented matrix. The elementary equation 
operations become the elementary row operations which act on the augmented 
matrix of the system. 

The elementary row operations on a matrix are: 


1. Switch two rows 
2. Multiply a row by a nonzero constant 
3. Add a multiple of one row to another 


The following notations for these operations will be useful: 


1. pjj - switch rows i and j 
2. m;(a) - multiply rowi by a 4 0 
3. tj; (a) - add to row j the value of a times row i 


The effect of pj; on a matrix A is denoted by p,;(A). Similarly for the other 
elementary row operations. 
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The corresponding operations when applied to the augmented matrix for the 
system in Example 11 becomes: 
0 
e) 


2 3 1-1 
P\2 
1-1 > {2 345 


1 -1]|0 10 
m (1/5) t21(1) 
— |0 I]1 — 101 


Above each arrow is the notation for the elementary row operation performed to 
produce the next augmented matrix. The sequence of elementary row operations 
chosen follows a certain strategy: Starting from left to right and top down, one tries 
to isolate a | ina given column and produce 0’s above and below it. This corresponds 
to isolating and eliminating variables. 

Let us consider three illustrative examples. The sequence of elementary row 
operation we perform is in accord with the Gauss—Jordan method which we will 
discuss in detail later on in this section. For now, verify each step. The end result 
will be an equivalent system for which the solution set will be transparent. 


5 
0 


Example 12. Consider the following system of linear equations: 


2x + 3y + 4z 
x +2y—-— z 


II 


Find the solution set and write it in the form x, + NS(A). 


> Solution. We first will write the augmented matrix and perform a sequence of 


elementary row operations: 
2 1 2-1]|2 
t12(—2) 
9| —~> |0-1 65 


23 4/9 12-1 
Pi2 
12 -1)2 mae 23 4 
12 
—5|- 


2 10 11 
t21(—2) 
—5| —— |01-6 


The last augmented matrix corresponds to the system 


x+ llz= 12 
y— 6 = 5. 
In the first equation, we can solve for x in terms of z, and in the second equation, 


we can solve for y in terms of z. We refer to z as a free variable and let z = a bea 
parameter in R. Then we obtain 
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x = 12-lla 
= —5 + 6a 
— a. 
In vector form, we write 
x 12—1la 12 -11 
X=/y/=]—-5+6a]=|]—-5]|+a@ 6 
z a 0 1 
12 
The vector, x» = | —5 | is a particular solution ( corresponding to a = 0) while all 
0 
-11 
multiples of the vector 6 | gives the null space of A. We have thus written the 
1 


solution in the form x,+ NS(A). In this case, there are infinitely many solutions. < 
Example 13. Find the solution set for the system 
3x + 2y+z2= 4 
2x + 2y+2z 
x+y +z7=0. 


II 


> Solution. Again we start with the augmented matrix and apply elementary row 
operations. Occasionally, we will apply more than one operation at a time. When this 
is so, we stack the operations above the arrow with the topmost operation performed 
first followed in order by the ones below it: 


321\4 11 1/0 ale -shlG 
t12(—2) 
2 2: 1|3'| sis Dae a: OF 21/3 
— 3 
11 1/0 gM (Oot ola 
1 1 1/0 iis ime 
m2(—1) 
ps. (OS 3l4 OG 12\=4 
ye m3(-1 
OSs oe boOGals 


110) 3 100; 1 
t32(—2) 

010) 2] 2c) }010] 2 
t31(—1) ane 
—_» |}001}-3 00 1)/-3 
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The last augmented matrix corresponds to the system 


= | 
= 2 
= —3., 
The solution set is transparent: x = 2 | . In this example, we note that NS(A) = 
—3 
{0}, and the system has a unique solution. < 


Example 14. Solve the following system of linear equations: 
x +2y + 4,=-2 


x + y + 3z 1 
2x + y +52 = 2. 


II 


> Solution. Again we begin with the augmented matrix and perform elementary 
row operations. 


12 4|-2 1 2 4\-2 
-1 
(eS a OF hee 3 
t13(—2) 
aS Be | O38 |e 


1 2 4{|-2 1 2 4/-2 
m(-1l) |}O 1 1}-3 22303) 01 1/-3 
0 —3 —3] 6 0 0 0/-3 


124/-2] #12 |10 2/0 
m3(—1/3) 01 1)-3 #3223) |01 1/0 


000} 1] t.-2 |000/1 
—> 


The system that corresponds to the last augmented matrix is 


x +2z= 0 
ytz=0 
0=1. 


The last equation, which is shorthand for 0x + Oy + 0z = 1, clearly has no solution. 
Thus, the system has no solution. < 
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Reduced Matrices 


These last three examples typify what happens in general and illustrate the three 
possible outcomes discussed in Corollary 8: infinitely many solutions, a unique 
solution, or no solution at all. The most involved case is when the solution set 
has infinitely many solutions. In Example 12, a single parameter a was needed to 
parameterize the set of solutions. However, in general, there may be many param- 
eters needed. We will always want to use the least number of parameters possible, 
without dependencies among them. In each of the three preceding examples, it was 
transparent what the solution was by considering the system determined by the last 
listed augmented matrix. The last matrix was in a certain sense reduced as simple as 
possible. 

We say that a matrix is in row echelon form (REF) if the following three 
conditions are satisfied: 


1. The nonzero rows lie above the zero rows. 

2. The first nonzero entry in a nonzero row is 1. (We call such a | a leading one.) 

3. For any two adjacent nonzero rows, the leading one of the upper row is to the 
left of the leading one of the lower row. (We say the leading ones are in echelon 
form.) 


We say a matrix is in row reduced echelon form (RREF) if it also satisfies 
4. The entries above each leading one are zero. 


Example 15. Determine which of the following matrices are row echelon form, 
row reduced echelon form, or neither. For the matrices in row echelon form, 
determine the columns (C) of the leading ones. If a matrix is not in row reduced 
echelon form, explain which conditions are violated. 


10-3 112 01014 010 
(1) }00 1 03] 2) }00102] @G) }000 
00 014 00000 001 


100430 ‘1959 010 2 
(4) }021202] (6) (6) |100-2 
0000 1 


000000 001 0 
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> Solution. 


1. (REF): Leading ones are in the first, third, and fourth columns. It is not reduced 
because there is a nonzero entry above the leading one in the third column. 

. (RREF): The leading ones are in the second and third columns. 

. Neither: The zero row is not at the bottom. 

. Neither: The first nonzero entry in the second row is not 1. 

. (REF): Leading ones are in the first and fifth columns. It is not reduced because 
there is a nonzero entry above the leading one in the fifth column. 

6. Neither: The leading ones are not in echelon form. < 


nb wWh 


Suppose a matrix A transforms by elementary row operations into a matrix A’ 
which is in row reduced echelon form. We will sometimes say that A row reduces 
to A’. The rank of A, denoted RankA, is the number of nonzero rows in A’. The 
definition of row reduced echelon form is valid for arbitrary matrices and not just 
matrices that come from a system of linear equations, that is, the augmented matrix. 
Suppose though that we consider a system Ax = b, where A is an m x n matrix. 
Suppose the augmented matrix [A|b] is row reduced to a matrix [A’|b’]. Let r = 
RankA and r, = Rank[A|b]. The elementary row operations that row reduce [A|b] 
to [A’|b’] are the same elementary row operations the row reduce A to A’. Further, 
A’ is row reduced echelon form. Hence, r is the number of nonzero rows in A’ and 
r < rp. Consider the following possibilities: 


1. If r < rp, then there is a row of the form [0---0|1] in [A’|b’] in which case 
rp = r + 1. Such a row translates into the equation 


Ox; +---+ 0x, = 1, 


which means the system is inconsistent. This is what occurs in Example 14. 
Recall that the augmented matrix row reduces as follows: 


12 4\/-2 1 0 2/0 
113) L}7-:->]0O1 1/0], 
215) 2 00 0/1 


where — --- — denotes the sequence of elementary row operations used. Notice 
that Rank(A) = 2 while the presence of [000|1] in the last row of [A’|b’] gives 
Rank[A|b] = 3. There are no solutions. 

2. Suppose r = rp. The variables that correspond to the columns where the leading 
ones occur are called the leading variables or dependent variables. Since each 
nonzero row has a leading one, there are r leading variables. All of the other 
variables are called free variables, and we are able to solve each leading variable 
in terms of the free variables and so there are solutions. The system Ax = b is 
consistent. Consider two subcases: 


580 8 Matrices 


a. Suppose r < n. Since there are a total of n (the number of columns of A) 
variables, there are n — r free variables and hence infinitely many solutions. 
This is what occurs in Example 12. Recall 

12 
ane. | 


23 4/9 10 11 

12 -1]2 01-6 
Here, we have r = RankA = Rank[A|b]=2 and n = 3. There is exactly 
n—r=3—2=1 free variable. 


b. Now suppose r = n. Then every variable is a leading variable. There are no 
free variables so there is a unique solution. This is what occurs in Example 13. 


Recall 
32 1/4 100; 1 
221/3)/—7:-:->]010] 2 
111)|0 00 1/-3 


Here we have r = RankA = Rank[A|b] = 3 and = 3. There are no free 
variables. The solution is unique. 


We summarize our discussion in the following proposition. 


Proposition 16. Let A be an m x n matrix and b an n x 1 column vector. Let 
r = RankA and ry = Rank[A|b]: 


1. Ifr < rp, then Ax = b is inconsistent. 
2. Ifr = 1p, then Ax = b is consistent. Further, 


a. ifr <n, therearen—r > 0 free variables and hence infinitely many solutions. 
b. ifr =n, there is exactly one solution. 


Example 17. Suppose the following matrices are obtained by row reducing the 
augmented matrix of a system of linear equations. Identify the leading and free 
variables and write down the solution set. Assume the variables are x,,.X2,.... 


i 


1140/2 oe 
wfooois| | 


0000/0 ee 

1 0f1 

1003 012 
(3)}010/4] (4 ]o0o/1 
00 1|5 0 0|0 

0 0|0 
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> Solution. 1. The zero row provides no information and can be ignored. The 
variables are x1, X2,x3, and x4. The leading ones occur in the first and fourth 
column. Therefore, x; and x4 are the leading variables. The free variables are 
X2 and x3. Let a = x2 and 6 = x3. The first row implies the equation 
X, + x2 +4x3 = 2. We solve for x; and obtain x} = 2—x.—4x3 = 2—a—4f. 
The second row implies the equation x4 = 3. Thus, 


x1 2—a—4B 2 —1 —4 
0 
x=)? = ae +a +B ; 
x3 B 0 
x4 3 3 0 0 


where a and 6 are arbitrary parameters in R. 
2. x, is the leading variable. a = x and 6 = x; are free variables. The first row 
implies x; = 1 — a. The solution is 


l-a 1 —l 0 
x= a|=|0|+e +B/0], 
B 0 0 


where @ and 6 are in R. 
3. The leading variables are x;, x2, and x3. There are no free variables. The solution 
set is 


4. The row [o (0) 1] implies the solution set is empty. < 


The Gauss—Jordan Elimination Method 


Now that you have seen several examples, we present the Gauss-Jordan elimination 
method for any matrix. It is an algorithm to transform any matrix to row reduced 
echelon form using a finite number of elementary row operations. When applied to 
an augmented matrix of a system of linear equations, the solution set can be readily 
discerned. It has other uses as well so our description will be for an arbitrary matrix. 


Algorithm 18. The Gauss—Jordan Elimination Method Let A be a matrix. 
There is a finite sequence of elementary row operations that transform A to a matrix 
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in row reduced echelon form. There are two stages of the process: (1) The first 
stage is called Gaussian elimination and transforms a given matrix to row echelon 
form, and (2) the second stage is called Gauss—Jordan elimination and transforms 
a matrix in row echelon form to row reduced echelon form. 


From A to REF: Gaussian Elimination 


1. Let A; = A. If A, = 0, then A is in row echelon form. 
2. If A; # 0, then in the first nonzero column from the left ( say the jth column), 
locate a nonzero entry in one of the rows (say the 7th row with entry a): 


a. Multiply that row by the reciprocal of that nonzero entry: m;(1/a). 
b. Permute that row with the top row: p,;. There is now a | in the (1, /) entry. 
c. If b is a nonzero entry in the (7, /) position for i # 1, add —b times the first 
row to the ith row: f ;(—b). Do this for each row below the first. 
The transformed matrix will have the following form: 


0---O1 * + x 
0---00 

: A 
0---00 


The *’s in the first row are unknown entries, and A> is a matrix with fewer 
rows and columns than A. 


WwW 


. If A> = 0, we are done. The above matrix is in row echelon form. 

4. If Ax ~ 0, apply step (2) to Ao. Since there are zeros to the left of Az and the 
only elementary row operations we apply affect the rows of A» (and not all of 
A), there will continue to be zeros to the left of A>. The result will be a matrix of 
the form 


GOs ae 


hy £0 Oise OO 
A3 
0O---000---00 


5. If A; = 0, we are done. Otherwise, continue repeating step (2) until a matrix 
Ax = 0 is obtained. 


From REF to RREF: Gauss—Jordan Elimination 


1. The leading ones now become apparent in the previous process. We begin with 
the rightmost leading one. Suppose it is in the kth row and /th column. If there 
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is a nonzero entry (b say) above that leading one, we add —d times the kth row 
to it: t, ;(—b). We do this for each nonzero entry in the /th column. The result is 
zeros above the rightmost leading one. (The entries to the left of a leading one 
are zeros. This process preserves that property.) 

2. Now repeat the process described above to each leading one moving right to left. 
The result will be a matrix in row reduced echelon form. 


Example 19. Use the Gauss—Jordan method to row reduce the following matrix to 
row reduced echelon form: 


23 804 
34 1118 
12 516 
-10-101 


> Solution. The Gauss—Jordan algorithm produces 


23 804 12 516 

t12(—3) 
34 1118 34 1118 
P13 t13(—2) 
12 516 vs 23 804 

ty4(1) 


-10-101 -10-101 ey 


5 1 
4-2 
m2(—1/2) 
—2 —2 -8 | —7 t24(—2) 
4 1 


6 
5 t23(1) 
8 
Aiea 


00013 t31(—1) 


00000 


1010-1 
0120 2 
0001 3 
0000 0O 


t21(—2) 
ss 


125 1 6 12516 
012 1 °5 m3(—1) 01215 t32(—1) 
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In the first step, we observe that the first column is nonzero so it is possible to 
produce a | in the upper left-hand corner. This is most easily accomplished by 
P13. The next set of operations produces 0’s below this leading one. We repeat 
this procedure on the submatrix to the right of the zeros. We produce a one in the 
2,2 position by m2(—4), and the next set of operations produce zeros below this 
second leading one. Now notice that the third column below the second leading one 
is zero. There are no elementary row operations that can produce a leading one in the 
(3, 3) position that involve just the third and fourth row. We move over to the fourth 
column and observe that the entries below the second leading one are not both zero. 
The elementary row operation m3(—1) produces a leading one in the (3, 4) position 
and the subsequent operation produces a zero below it. At this point, A has been 
transformed to row echelon form. Now starting at the rightmost leading one, the 1 
in the (3, 4) position, we use operations of the form 13; (a) to produce zeros above 
that leading one. This is applied to each column that contains a leading one. The 
result is in row reduced echelon form. < 


The student is encouraged to go carefully through Examples 12-14. In each of 
those examples, the Gauss—Jordan Elimination method was used to transform the 
augmented matrix to the matrix in row reduced echelon form. 


A Basis of the Null Space 


When the Gauss-Jordan elimination method is used to compute the null space of A, 
the solution space takes the form 


{Qyv, +--+ OVE 2 O1,...,a% € R}. (3) 
We simplify the notation and write Span{v,,...,vx<} for the set of all linear 
combinations of vj,..., Vx given by (3). The vectors v;,...,V,% turn out to also 


be linearly independent. The notion of linear independence for linear spaces of 
functions was introduced earlier in the text and that same notion extends to vectors 
in R’. 

Before we give the definition of linear independence, consider the following 
example. 


Example 20. Find the null space of 


23 14 
11-12 


35 36 
ects 
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> Solution. We augment A with the zero vector and row reduce: 


23 14-2/0 11-12 3/0 
11-12 3/0 23 14-2)/0 
55) B6S7T0) “P13 Ss S6e7 10 
45-18 4)]0 45-18 4|0 
11-12 3)0 11-12 3/0 
t12(—2) 
01 30 —8/0] m3(-2) }O1 30 —-—8]0 
3 
1 192 60-16/0| nx» [00 00 olo 
tr 4(—4) — 
—_+, [01 30 —8/0 00 00 O;0 
10-42 11)0 
01 30 -8/0 
to1(-1) 
» 100 00 O;0 
00 00 O/0 
If the variables are x1,...,%5, then x; and x are the leading variables and x3, x4, 


and xs are the free variables. Let a = x3, B = x4, and y = x5. Then 


x] 4a — 2B —1ly 4 —2 -l11 
x2 —3a + 8y —3 0 8 
x3/ = al=a|] 1/+ 6] ol|+y 0 
x4 B 1 0 
X5 y 0 0 1 


It follows that 


4 —2 —11 
—3 0 8 

NS(A) = Span 1],] O|. 0 < 
0 1 0 
0 0 1 

We say that vectors v;,..., Vv, in R” are linearly independent if the equation 
avyjt+es tay, =90 
implies that the coefficients a,,...,a, are all zero. Otherwise, they are said to be 


linearly dependent. 
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Example 21. Show that the vectors 


4 —2 -l11 

—3 0 8 

Y= 1]. v= 0}, and v3 = 0 
0 1 0 

0 0 1 


that span the null space in Example 20 are linearly independent. 


> Solution. The equation a; vy + a2V2 + a3Vv3 = 0 means 


4a, —2a3 — 11a3 0 
—3a, + 8a3 0 

a,| =1|0 

ao 0) 

a3 0 


From the last three rows, it is immediate that aj = a2 = a3 = 0. This implies the 
linear independence. < 


Suppose V is a linear subspace of IR”. By this we mean that V is in R” and is 
closed under addition and scalar multiplication. That is, if 


1. v1, V2 are in V, then so is vj + V2 
2.c €Randve V,thencve V. 


We say that the set of vectors B = {v1,..., Vx} forms a basis of V if B is linearly 
independent and spans V. Thus, in Example 20, the set {v1, V2, v3} is a basis of 
NS(A). We observe that the number of vectors is three: one for each free variable. 


Theorem 22. Suppose A is anm xn matrix of rank r then there aren —r vectors 
that form a basis of the null space of A. 


Proof. Suppose [A|0] is row reduced to [R|0], in row reduced echelon form. By 


Theorem 16, there are n — r free variables. Let k = n —r. Suppose fi,..., fx are 
the columns of R that do not contain leading ones. Then x7,,...,x , are the free 
variables. Leta; = x 7,, j = 1,...,k be parameters. Solving for x in Rx = 0 in 
terms of the free variables, we get vectors vj,..., vg such that 


X= QV, +++ + AVE. 


It follows that v,,..., vx span NS(A). Since R is in row reduced echelon form, the 
ff entry of v; is one while the i entry of v; is zero, wheni 4 j. If ayvj + 
+++ + agv, = 0, then the ity entry of the left-hand side is a;, and hence, a; = 0, 
j = 1,...k. It follows that v1,..., vg are linearly independent and hence form a 
basis of NS(A). Oo 
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Exercises 


1-2. For each system of linear equations, identify the coefficient matrix A, the 
variable matrix x, the output matrix b, and the augmented matrix [A|b]. 


1. 
x + 4y + 3z=2 
x+ y- z=4 
2x + z= 1 
y- z=6 
2. 
2x, — 3x. + 4x3 + x4 = 0 
3x, + 8x. — 3x3 — 6x4 = 
xX] 
1 O-1 4 3 2 
| 3-321 - 1 
3. Suppose A = »X= |x; ],andb= . Write out 
3-2 8 4-3 3 
x4 
-8§ 2 0 2 1 —4 
X5 


the system of linear equations that corresponds to Ax = b. 


4-9. In the following, matrices identify those that are in row reduced echelon form. 
If a matrix is not in row reduced echelon form, find a single elementary row 
operation that will transform it to row reduced echelon form and write the new 
matrix. 


10 1 
4,.A=1]00 0 
01-4 


5 A= 104 
012 

12101 

01311 


0103 
7.A=|10026 


0000 


6. A 


588 


01103 
=|/00012 
00000 


10103 
=/01341 
30309 
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10 —18. Use the Gauss-Jordan elimination method to row reduce each matrix. 


11. 


12. 


13. 


14. 


15. 


—3 1 


7-1-4001 


124 
248 
=190 
168 
044 
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5181 
1140 
2021 
4171 


2 8006 
17. 1 4117 
—-1-4010 


1-1 1-1 1 
1 1-1-1 1 
-I1-1 1 1-1 
1 1-1 1-1 


19-25. Solve the following systems of linear equations: 


19. 


20. 


21. 


22. 


x + 3y = 2 


5x 


+ 3z=-5 


3x — yrt2z= —4 


+ 2x2 + 9x3 + 8x4 = 


+ 
+ 
+ 


x3 + 2x4 


x2 + x3 — 3x4 = 
X2 + 4x3 + 3x4 


—x + 4y = -3x 


—2x) — 


23; 


—XxX, — 


xX, + 


2x 
2x 
2x 


x—- y= —3y 


8X2 —X3 -— X= 
4x —x4= 
4x. + x3 + X4 


II 


+ 3y + 8 =5 
+ y+ 10z = 3 
+ 8&=4 


589 


590 


24. 


25. 


Xp + X2 
x2 
xX) + 3x. 


+ 2x3 
+ 4x3 


+++ 4+ + 


x3+ 5x4 => 
x3+ 4x4 = 


x3 + 2x4 
3x3 + 1llx4 
2x3 + 7x4 


3 + X1 
4 + 
11 + X1 + 


X2 + X3 


2X2 + 2x3 
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26-32. For each of the following matrices A, find a basis of the null space. 


28. 


29. 


30. 


31. 


1 
._A= : 
35 
2 6 
A=| 1 3 
—1 -3 
131 
A= : 
141 
11 3-2 
A=|/14 1 1 
4710-5 
-1 21 1 
=2 1 
A= 6 3 
2-10 4 
5 17-9 
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23 1 93 
01-3 40 
32. A= 
21 7 13 
44 8106 
33. Suppose the homogeneous system Ax = 0 has the following two solutions: 
1 1 5 
1 | and | —1 }.Is | —1 |] asolution? Why or why not? 
2 0 4 


34. For what value of k will the following system have a solution: 


Xi + X- X38 = 
2x, + 3x. + x3 = 4 


= 2X2 = 10x3 = 


134 1 1 1 
35-36. Let A = | 2 17],b: = ]0],bo =] 1] andb; = } 1 
110 0 0 1 


35. Solve Ax = b;, for eachi = 1, 2,3. 
36. Solve the above systems simultaneously by row reducing 


134/111 
[A|bi|b2|b3] = | —2 1 7/01 1 
110/001 
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8.3 Invertible Matrices 593 
8.3 Invertible Matrices 


Let A be a square matrix. A matrix B is said to be an inverse of Aif BA = AB = T. 
In this case, we say A is invertible or nonsingular. If A is not invertible, we say A 


is singular. 
1 
A= : 
—-4 -1 


Show that A is invertible and an inverse is 


-1 -1 
B= : 
4 3 
> Solution. Observe that 
AB = 3 1}}/-1 -l = 1 O 
—-4 -1 4 3 0 1 
BA= -l1 -1 3 1 = 1 Oy a 
4 3/)}-4 —-1 0 1 


The following proposition says that when A has an inverse, there can only be 
one. 


Example 1. Suppose 


and 


Proposition 2. Let A be an invertible matrix. Then the inverse is unique. 


Proof. Suppose B and C are inverses of A. Then 


B= BI = B(AC) = (BA)C = IC =C. Oo 
Because of uniqueness, we can properly say the inverse of A when A is invertible. 


-1-1 
In Example 1, the matrix B = ( P 7 is the inverse of A; there are no others. It 


is standard convention to denote the inverse of A by A7!. 

We say that B is a left inverse of A if BA = I and aright inverse if AB = I. 
For square matrices, we have the following proposition which we will not prove. 
This proposition tells us that it is enough to check that either AB = J or BA = I. 
It is not necessary to check both products. 


Proposition 3. Suppose A is a square matrix and B is a left or right inverse of A. 
Then A is invertible and A~' = B. 
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For many matrices, it is possible to determine their inverse by inspection. For 
example, the identity matrix J, is invertible and its inverse is [,: InJ, = In. 
A diagonal matrix diag(a,,...,d,) is sa if each a; #~ 0,i = 1,...,n. 


. However, if one of the a; is zero, 


The inverse then is simply diag ore pase ae 
then the matrix in not invertible. Even more is true. If A has a zero row, say the 
ith row, then A is not invertible. To see this, we get from (2) of Sect.8.1 that 
Row;(AB) = Row;(A)B = 0. Hence, there is no matrix B for which AB = 


Similarly, a matrix with a zero column cannot be invertible. 
Proposition 4. Let A and B be invertible matrices. Then 


1. A7 is invertible and (A~!)~! = 
2. AB is invertible and (AB)! = =. “1 4- d 


Proof. Suppose A and B are invertible. The symmetry of the equation A~!A 
AA7! = IJ says that A™! is invertible and (A~!)~! = A. We also have 


II 


(B-1A7!)(AB) = B71(A1A)B = BIB = B'B=I. 


This shows (AB)! = B7!A7!. Oo 
The following corollary easily follows by induction: 


Corollary 5. [f A = A,-+:Ax is the product of invertible matrices, then A is 
invertible and A~'! = Ay! «++ Aj!. 


The Elementary Matrices 
When an elementary row operation is applied to the identity matrix /, the resulting 


matrix is called an elementary matrix. 


Example 6. Show that each of the following matrices are elementary matrices: 


0100 
10 ree 1000 

FE, = » Ao=]010],. B= 
03 0010 


021 
0001 
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> Solution. We have 
100 


010] = £2, 
021 


tr3(2)I 


0100 
1000 
0010 
0001 


— £3, 


Pi2l 


where the size of the identity matrix matches the size of the given matrix. < 


The following example shows a useful relationship between an elementary row 
operation and left multiplication by the corresponding elementary matrix. 


Example 7. Use the elementary matrices in Example 6 to show that multiplying a 
matrix A on the left by E; produces the same effect as applying the corresponding 
elementary row operation to A. 


A A 
> Solution. 1. Let A = | Then E}A = Pa = m2(3)A. 


Ad 2 
Ai] | A\ 
2. Let A= | A, |. Then E2A = Ao | = 123(2)A. 
ae 
At A 
A A 
3. Let A= |°7 |. Then £34 = |! | = pio. < 
3 3 
Ag Ag 


This important relationship is summarized in general as follows: 


Proposition 8. Let e be an elementary row operation. That is, let e be one of pj ;, 
ti ; (a), or mj(a). Let E = el be the elementary matrix obtained by applying e to 
the identity matrix. Then 


e(A) = EA. 
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In other words, when A is multiplied on the left by the elementary matrix E, it is the 
same as applying the elementary row operation e to A. 


If E = eT is an elementary matrix, then we can apply a second elementary 
row operation to EF to get J back. For example, consider the elementary matrices in 
Example 6. It is easy to see that 


mo(1/3)Fi =T1, t23(—2)E2 = 1, and pi2k3=T7. 


In general, each elementary row operation is reversible by the another elementary 
row operation. Switching two rows is reversed by switching those two rows again, 
thus p> : = p; ;. Multiplying a row by a nonzero constant is reversed by multiplying 
that same row by the reciprocal of that nonzero constant, thus (m;(a))~! = 
m;(1/a). Finally, adding a multiple of a row to another is reversed by adding the 
negative multiple of first row to the second, thus (fj ; (a))! = t ;(—a). If e is an 
elementary row operation, we let e~! denote the inverse row operation. Thus, 


ee [A= A, 


for any matrix A. These statements imply 


Proposition 9. An elementary matrix is invertible and the inverse is an elementary 
matrix. 


Proof. Let e be an elementary row operation and e~! its inverse elementary row 
operation. Let E = e(/) and B = e'T. By Proposition 8, we have 


EB = E(e'1) =ee'J =I. 


It follows the E is invertible and E~! = B = e~!(J) is anelementary matrix. O 
We now have a useful result that will be used later. 
Theorem 10. Let A by ann Xx n matrix. Then the following are equivalent: 


1. A is invertible. 
2. The null space of A, NS(A), consists only of the zero vector. 
3. A row reduces (by Gauss—Jordan) to the identity matrix. 


Proof. Suppose A is invertible and e € NS(A). Then Ac = 0. Multiply both sides 
by A7! to get 

c= A'Ac= A'0=0. 
Thus, the null space of A consists only of the zero vector. 


Suppose now that the null space of A is trivial. Then the system Ax = 0 is 
equivalent to 
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X, = 0 


Thus, the augmented matrix [A | 0] reduces to [J | 0]. The same elementary row 
operations row reduces A to the identity. 
Now suppose A row reduces to the identity. Then there is a sequence of 


elementary matrices, E),..., Ex, (corresponding to the elementary row operations) 
such that £,--- E,;A = J. Let B = E,--- Ex. Then BA = J and this implies A is 
invertible. Oo 


Corollary 11. Suppose A is ann x n matrix. If the null space of A is not the zero 
vector, then A row reduces to a matrix that has a zero row. 


Proof. Suppose A transforms by elementary row operations to R which is in row 
reduced echelon form. The system Ax = 0 has infinitely many solutions, and this 
only occurs if there are one or more free variables in the system Rx = 0. The 
number of leading variables which is the same as the number of nonzero rows is 
thus less than n. Hence, there are some zero rows. oO 


Inversion Computations 


Let e; be the column vector with | in the ith position and 0’s elsewhere. By 
Equation 8.1.(1), the equation AB = TJ implies that ACol;(B) = Col;(/) = e;. 
This means that the solution to Ax = e; is the ith column of the inverse of A, when 
A is invertible. We can thus compute the inverse of A one column at a time using 
the Gauss—Jordan elimination method on the augmented matrix [Ale;]. Better yet, 
though, is to perform the Gauss—Jordan elimination method on the matrix [A|/], 
that is, the matrix A augmented with /. If A is invertible, it will reduce to a matrix 
of the form [7|B] and B will be A~!. If A is not invertible, it will not be possible to 
produce the identity in the first slot. 
We illustrate this in the following two examples. 


Example 12. Determine whether the matrix 


2 03 
A=|l0 11 


3-14 


is invertible. If it is, compute the inverse. 
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> Solution. We will augment A with J and follow the procedure outlined above: 


2 03{100 1-11/-101 
t13(-D t) 3(—2) 
0 111010 0 11) 010 


3 (—2) 
BT BOO A ewes \E G08), T0t0 | ae 


1-1 1IJ-1 O 1] m ey }1—-1 0} 2-2-1 
0 1 1] 0 1 Of} gBHp]O 10) 3-1 -2 t21(1) 


0 Ob) B99) Wey 10. O13 “2 7 
—> 
100} 5-3 -3 
010; 3-1-2 
001|/-3 2 2 
5 -—3 -3 
It follows that A is invertible and A~! = 3-1] -2]. < 
—3 2 2 
1-40 
Example 13. Let A= |2 1 3] . Determine whether A is invertible. If it is, find 
0 —7 3 


its inverse. 


> Solution. Again, we augment A with J and row reduce: 


1-40/100 1-40) 1 00 
t12(—2) 

2 13/010 0 93/2 10 
t23(—1) 


0 93/001} ~ , ]o oo] 2-11 


We can stop at this point. Notice that the row operations produced a 0 row in the 
reduction of A. This implies A cannot be invertible. < 


Solving a System of Equations 


Suppose A is a square matrix with a known inverse. Then the equation Ax = b 
implies x = A~!Ax = A~'b and thus gives the solution. 
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Example 14. Solve the following system: 


| 


2x+ 43z= 
yr Zz 


38x —-y+t4c2=3. 


> Solution. The coefficient matrix is 


2 03 
Aa |0.: 44 
S-4 


whose inverse we computed in the example above: 


5 —3 —3 
Ast =|) Se) 
= 3, 2 32. 
The solution to the system is thus 
5 —3 —3]] 1 
x=A'b=/] 3-1-2||2 
ao 2? 213 


ll 
) 


599 
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8.3 Invertible Matrices 601 
Exercises 


1-12. Determine whether the following matrices are invertible. If so, find the 
inverse: 
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-1 1 1-t 
1-1 1-1 
1 1-1-1 

-l1-1-1 1 


10. 


0100 
1010 
O11 
1111 


11. 


—3 2-8 2 
0 2-3 5 
1: 2 3.5 
1-1 1-1 


12. 


13-18. Solve each system Ax = b, where A and b are given below, by first 
computing A~! and applying it to Ax = b to getx = A“'b. 


111 1 
14.A=]012 b= 0 
001 —3 
1 0-2 —2 
15. A=]2-2 0 b= 
1 2-1 2 
1-1 1 1 
16.A=|-2 5-2] b=]1 
0 2-1 1 
1 3 O1 
A= 2 2-20 b= 0 
1-1 04 —l 
1 2 39 2 


8.3 


18. 


19. 


20. 


21. 


22. 
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0100 1 
1010 —l1 
A = b = 
0111 —2 
1111 1 


Suppose A is an invertible matrix. Show that A’ is invertible and give a formula 
for the inverse. 


0 sin@ 
Let E(@) = eee | Show E(@) is invertible and find its inverse. 


—sin@ cos@ 


inh he 
Let F(6) = sinh 6 cos 
cosh@ sinh@ 


Suppose A is invertible and AB = AC. Show that B = C. Give an example 
of a nonzero matrix A (not invertible) with AB = AC, for some B and C, but 


BHC. 


. Show F(@) is invertible and find its inverse. 
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8.4 Determinants 605 
8.4 Determinants 


In this section, we will discuss the definition of the determinant and some of its 
properties. For our purposes, the determinant is a very useful number that we can 
associate to a square matrix. The determinant has an wide range of applications. 
It can be used to determine whether a matrix is invertible. Cramer’s rule gives the 
unique solution to a system of linear equations as the quotient of determinants. In 
multidimensional calculus, the Jacobian is given by a determinant and expresses 
how area or volume changes under a transformation. Most students by now are 


b 
familiar with the definition of the determinant for a 2 x 2 matrix: Let A = : | 3 
Cc 


The determinant of A is given by 
det(A) = ad — be. 


It is the product of the diagonal entries minus the product of the off diagonal entries. 


1 3 
For example, det |! | = 1-(-2)-5-3=-17. 


The definition of the determinant for an n x n matrix is decidedly more 
complicated. We will present an inductive definition. Let A be ann Xx n matrix and 
let A(i, 7) be the matrix obtained from A by deleting the ith row and jth column. 
Since A(i, 7) is an (n — 1) x (n — 1) matrix, we can inductively define the (i, 7) 
minor, Minor; ; (A), to be the determinant of A(i, j): 


Minor; ; (A) = det(A(i, j)). 
The following theorem, whose proof we omit, is the basis for the definition of 


the determinant. 


Theorem 1 (Laplace Expansion Formulas). Suppose A is ann x n matrix. Then 
the following numbers are all equal and we call this number the determinant of A: 


det A = Y\(-1)'*/a;,; Minor; ; (A) for eachi 
j=l 
and 


det A = )°(-1)'*/a;,; Minor; ;(A) for each j. 


i=1 


Any of these formulas can thus be taken as the definition of the determinant. In 
the first formula, the index 7 is fixed and the sum is taken over all j. The entries a; ; 
thus fill out the ith row. We therefore call this formula the Laplace expansion of 
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the determinant along the ith row or simply a row expansion. Since the index i can 
range from | ton, there are n row expansions. In a similar way, the second formula 
is called the Laplace expansion of the determinant along the jth column or simply 
a column expansion and there are n column expansions. The presence of the factor 
(—1)'*/ alternates the signs along the row or column according as i + j is even or 
odd. The sign matrix 

— ao — ee 


is a useful tool to organize the signs in an expansion. 

It is common to use the absolute value sign |A| to denote the determinant of A. 
This should not cause confusion unless A is a 1 x 1 matrix, in which case we will 
not use this notation. 


Example 2. Find the determinant of the matrix 


> Solution. For purposes of illustration, we compute the determinant in two ways. 
First, we expand along the first row: 


24 
05 


34 
15 


det A =1- =e) + (—2) 


q2 
‘ = 1-(—-10) —2-(11) — 2(2) = —36. 


Second, we expand along the second column: 


34 
15 


det A = (-)2|° 4] + C2|' 7] G0 a = (-2)- 12-1) = 36. 


1 —2 
1 5 


Of course, we get the same answer; that is what the theorem guarantees. Observe 
though that the second column has a zero entry which means that we really only 
needed to compute two minors. In practice, we usually try to use an expansion along 
arow or column that has a lot of zeros. Also note that we use the sign matrix to adjust 
the signs on the appropriate terms. < 
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Properties of the Determinant 


The determinant has many important properties. The three listed below show how 
the elementary row operations affect the determinant. They are used extensively to 
simplify many calculations. 


Proposition 3. Let A be ann x n matrix. Then 


1. det p;,;(A) = —det A. 
2. detm;(a)(A) = adet A. 
3. det fj, ; (A) = det A. 


Proof. We illustrate the proof for the 2 x 2 case. Let A = |" | . We then have 
tu 
tu 
1. | pi2(A)| = =ts—ru=-—|A|. 
rs 
ar as 


2. |m(a)(A)| = 


= aru—ast =alAl. 
u 


s 
=r(u+as)—s(t+ar)=ru—st=|A|. O 
t+aru+as 


3. ti2(a)(A)| = 


Another way to express 2. is 
2’. If A! = m;(a)A then det A = + det 4’. 
Corollary 4. Let E be an elementary matrix. Consider the three cases: If 


1. E = p;j;I1, thendetE = —1. 
2. E=m;,(a)I, then det E = a. 
3. E=1t;;1, thendet E = 1. 


Furthermore, 
det EA = det E det A. 


Proof. Let A = I in Proposition 3 to get the stated formulas for det E. Now let 
A be an arbitrary square matrix. The statement det EA = det E det A is now just 
a restatement of Proposition 3 and the fact thateA = EA for an elementary row 
operation e and its associated elementary matrix EF. Oo 


Further important properties include: 


Proposition 5. 7. det A = det A’. 

2. If A has a zero row (or column), then det A = 0. 

3. If A has two equal rows (or columns), then det A = 0. 

4. If A is upper or lower triangular, then the determinant of A is the product of the 
diagonal entries. 
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Proof. 1. The transpose changes row expansions to column expansions and column 


2: 


expansions to row expansions. By Theorem |, they are all the same. 
All coefficients of the minors in an expansion along a zero row (column) are zero 
so the determinant is zero. 


. If the ith and jth rows are equal, then det A = det(p;,; A) = — det A and this 


implies det A = 0. If A has two equal columns, then A‘ has two equal rows. 
Thus, det A = det A‘ = 0. 


. Suppose A is upper triangular. Expansion along the first column gives 


a\;Minor,(A). But Minor,;(A) is an upper triangular matrix of size one less 
than A. By induction, det A is the product of the diagonal entries. Since the 
transpose changes lower triangular matrices to upper triangular matrices, we get 
that the determinant of a lower triangular matrix is likewise the product of the 
diagonal entries. oO 


Example 6. Use elementary row operations to find det A if 


Lo 41 
ae 12 13 
()A=}]-135] and (2)A= 
22 166 
011 
31 01 


> Solution. Again we will write the elementary row operation that we have used 
above the equal sign. 


242 121 121 
ay 135)" 2[-135] ™? 2lo56 
ort) for Jot 
121 121 
G14) S204 A 

= ieee  ‘eeal 


For the first equality, we have used (3’) above, and in the last equality, we have 


used the fact that the last matrix is upper triangular and its determinant is the product 
of the diagonal entries: 
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ti2(1) 


10 51 10 5 1 
t13(—2) 
-12 13 02 6 4 
(2) tia(—3) =O), 
22 16 6 02 6 4 
31 01,  |01-15 -2 
with the last equality because two rows are equal. < 


In the following example, we use elementary row operations to zero out entries 
in a column and then use a Laplace expansion formula. 


Example 7. Find the determinant of 


jie ee 
DF3 0 
A 
21-1 A 
O13 2 
> Solution. 
bAD 1 14 2-1 
$93:.9)°* > Jo s6e4.-2 
det(A) = 1 3(1) 
=i 7.9% 0 5 4 3 
013 2 7 0 13 2 
6 Il, gate 0 17 14 
= 5 43} nK5) O=11 =7 
1 32 = — 
17 14 
= = —119+154= 35, <j 
yh ee 


The following two theorems state very important properties about the 
determinant. 


Theorem 8. A square matrix A is invertible if and only if det A # 0. 
Proof. Apply Gauss—Jordan to A to get R, a matrix in row reduce echelon form. 


There is a sequence of elementary row operations e,,..., ex such that 


ey--eeA=R. 
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Let E; = e;/,i = 1,...,k be the corresponding elementary matrices. Then 
E,-+-ExA=R. 
By repeatedly using Corollary 4, we get 
det E, det F,---det E, det A = det R. 


Now suppose A is invertible. By Theorem 10 of Sect. 8.3, R = J. Since each factor 
det E; 4 0 by Corollary 4, it follows that det A ~ 0. On the other hand, if A is not 
invertible, then R has a zero row by Theorem 10 of Sect. 8.3 and Corollary 11 of 
Sect. 8.3. By Proposition 5, we have det R = 0. Since each factor F; has a nonzero 
determinant, it follows that det A = 0. oO 


Theorem 9. [f A and B are square matrices of the same size, then 


det(AB) = det A det B. 


Proof. We consider two cases. 
1. Suppose A is invertible. Then there is a sequence of elementary matrices such 
that A = EF) --- E;. Now repeatedly use Corollary 4 to get 
det AB = det F,--- E, B = det FE, --- det FE; det B = det A det B. 


2. Now suppose A is not invertible. Then AB is not invertible for otherwise there 
would be a C such that (AB)C = I. But by associativity of the product, we 
have A(BC) = I, and this implies A is invertible (with inverse BC). Now by 
Theorem 8, we have det AB = 0 and det A = 0 and the result follows. oO 


The Cofactor and Adjoint Matrices 


Again, let A be a square matrix. We define the cofactor matrix, Cof(A), of A to 
be the matrix whose (i, j)-entry is (—1)'*/ Minor;,;. We define the adjoint matrix, 
Adj(A), of A by the formula Adj(A) = (Cof(A))’. The important role of the adjoint 
matrix is seen in the following theorem and its corollary. 


Theorem 10. For A a square matrix, we have 
A Adj(A) = Adj(A) A = det(A)/. 


Proof. The (i, 7) entry of A Adj(A) is 


n 


Y= Aix (Adj(A))e | = SO(- ‘4 Aj Minor; (A). 
k=0 k=0 
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When i = j, this is a Laplace expansion formula and is hence det A by Theorem 
1. Wheni +# /, this is the expansion of a determinant for a matrix with two equal 
rows and hence is zero by Proposition 5. oO 


The following corollary immediately follows. 


Corollary 11 (The Adjoint Inversion Formula). /f det A 4 0, then 
a Adj(A) 
~ deta” 
The inverse of a 22 matrix is a simple matter: Let A = |: . Then Adj(A) = 
c 


a 7 and if det(A) = ad — bd # 0, then 
a 


1 d— 
Ma oe| oO. () 
ad—bc|—c¢ a 
For an example, suppose A = ; = . Then det(A) = 1— (6) = -5 £080 A 
=l =3 
is invertible and A~! = + 1 | = 5 5 
21 =2. =1 
5S 


The general formula for the inverse of a 3 x 3 is substantially more complicated 
and difficult to remember. Consider though an example. 


Example 12. Let 
120 
A= 141 
-103 
Find its inverse if it is invertible. 


> Solution. We expand along the first row to compute the determinant and get 


4] 11 
det(A) = 1 det ; | - 2as| Af = 1(12) — 2(4) = 4. Thus, A is invertible. 
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12-4 4 
The cofactor of A is Cof(A) = |-—6 3-2] and Adj(A) = Cof(A)' = 
2-1 2 
12-6 2 
—4 3-1]. The inverse of A is thus 
4-2 2 
1r=6. 33 4 
At=—-|-4 3-1}=|-1 34 < 
49-3. 9 13 5 


In our next example, we will consider a matrix with entries inR = R[s]. Such 


matrices will arise naturally in Chap. 9. 
Example 13. Let 


121 
A=]013 
112 


Find the inverse of the matrix 


ea 2. 2a 
sI-A= CesT <3 
Hy AP yeo 


> Solution. A straightforward computation gives 
det(sI — A) = (s — 4)(s? + 1). 
The matrix of minors for sJ — A is 


|@-D-2)-3 = s—1 
—2(s —2)-—1 (s—1)(s—2)-—1 -—(6-1)-2 
| 6+ (s—1) —3(s— 1) (s — 1)? 
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After simplifying, we obtain the cofactor matrix 


s*— 35-1 3 sl 
2s—357-354+1 s+] 
s+5 3s —3 (s—1)? 


The adjoint matrix is 


s*—35-1 25-3 s+5 
3s?-—3s+1 35-3 


s—l s+1(s—1) 
Finally, we obtain the inverse: 
s?—35-1 25-3 s+5 
(s—4)(s2+1) (s—4)(s2+1)  (s—4)(s2+1) 
(sI =A _ 3 s?—3s+1 3s—3 ; < 


G-A() GAN GHC) 
s-l s+] (s—1)? 
G-42) GAC G—HO241) 


Cramer’s Rule 


We finally consider a well-known theoretical tool used to solve a system Ax = b 
when A is invertible. Let A(i,b) denote the matrix obtained by replacing the ith 
column of A with the column vector b. We then have the following theorem: 


Theorem 14. Suppose det A # 0. Then the solution to Ax = b is given coordinate- 
wise by the formula 


_ det A(i, b) 
det A 


Proof. Since A is invertible, we have 


Xj 


(A7'b); = SO(A)i ede 


k=1 
i cae 
= — )0(-1)'t Minor, ; (A) bx 
det A ae 


det A(i, b) 


= 1)'** by Minor, ; (A 
yew «Minor: (A) = 55 a 


ee 
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The following example should convince you that Cramer’s rule is mainly a 
theoretical tool and not a practical one for solving a system of linear equations. 
The Gauss—Jordan elimination method is usually far more efficient than computing 
n + | determinants for a system Ax = b, where A isn xn. 


Example 15. Solve the following system of linear equations using Cramer’s rule: 


x+y+z= 0 


2x + 3y —z= 11 
x +z=-2 
> Solution. We have 
11 1 
det A = |2 3 —1|] = -3, 
10 1 
01 1 
det A(1,b) = | 11 3 —1} = -3, 
—20 1 
1 0 1 
det A(2,b) = |2 11 —1] =—6, 
1—2 1 
11 0 
and det A(3,b) = |2 3 11| = 9, 
10-2 


i 

where b = | 11 |. Since det A ¥ 0, Cramer’s rule gives 

2) 
detA(1,b) — —3 


xy = = 1; 
det A —3 


det A(2,b) _ —6 
det A 3 


x2= = 2, 


and 
_ det A(3, b) 7 9 


= eee 
as det A = = 
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Exercises 


1-9. Find the determinant of each matrix given below in three ways: a row 
expansion, a column expansion, and using row operations to reduce to a triangular 
matrix. 


1 | 4 
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24 2 3 
12 1 4 
48 4 6 
1911 13 


10-15. Find the inverse of (sJ — A) and determine for which values of s det(sJ — 
A) = 


16-24. Use the adjoint formula for the inverse for the matrices given below. 


14 
16. 
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11-1 
19./14 0 
23 1 


403 
817 
341 


20. 


3 98 100 
0 2 99 
00 1 


| 
01-24 
2 

79. 3 92 
14 83 


23-24 


-49-4 1 
23 0-4 
—23 5-6 
—-32 0 1 


23. 


24 2 3 
12 1 4 
48 4 6 
19 11 13 


24. 


25-28. Use Cramer’s rule to solve the system Ax = b for the given matrices A 
and b. 


mold ef 


26. A=/]012 b= 0 


618 


1 0-2 2 
27. A=|]2-—2 0 b= 
1 2-1 2 
1 3 O01 
2 A= 2 2-20 b= 0 
1-1 04 —1 
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8.5 Eigenvectors and Eigenvalues 


Suppose A is a square 1 x n matrix. Again, it is convenient to think of R” as the set 
of column vectors M,, (IR). If v € R”, then A transforms v to a new vector Av as 
seen below. 


Av 


As illustrated, A rotates and compresses (or stretches) a given vector v. However, if 
a vector v points in the right direction, then A acts in a much simpler manner. 
We say that s is an eigenvalue of A if there is a nonzero vector v in R” such that 


Av = sv. (1) 


The vector v is called an eigenvector' associated to s. The pair (s,v) is called an 
eigenpair. One should think of eigenvectors as the directions for which A acts by 
stretching or compressing vectors by the length determined by the eigenvalue s: if 
s > 1, the eigenvector is stretched; if 0 < s < 1, then the eigenvector is compressed; 
if s < 0, the direction of the eigenvector is reversed; and if s = 0, the eigenvector is 
in the null space of A. See the illustration below. 


s>l 0<s<l s5=0 
Av v va 
Vv ay Av 
-l<s<0 s<-l 
Vv Vv 
Av Av 


This notion is very important and has broad applications in mathematics, computer 
science, physics, engineering, and economics. For example, the Google page rank 
algorithm is based on this concept. 


'Rigenvectors and eigenvalues are also called characteristic vectors and characteristic values, 
respectively. 
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In this section, we discuss how to find the eigenpairs for a given matrix A. We 
begin with a simple example. 


—3 1 
Example 1. Suppose A = i . Let 


-h-t-L) fd 


Show that vy and v2 are eigenvectors for A. What are the associated eigenvalues? 
Show that v3 and vq are not eigenvectors. 


> Solution. We simply observe that 


m= GE -F-f 


Thus, vy an eigenvector with eigenvalue 1. 


We see that Av3 is not a multiple of v3. It is not an eigenvector. 
4. Eigenvectors must be nonzero so V4 is not an eigenvector. < 


To find the eigenvectors and eigenvalues for A, we analyze (1) a little closer. Let 
us rewrite it as sv — Av = 0. By inserting the identity matrix, we get sJv— Av = 0, 
and by the distributive property, we see (1) is equivalent to 


(sI — A)v = 0. (2) 


Said another way, a nonzero vector v is an eigenvector for A if and only if it is in 
the null space of sJ — A for an eigenvalue s. Let E, be the null space of sJ — A; it 
is called the eigenspace for A with eigenvalue s. So once an eigenvalue is known, 
the corresponding eigenspaces are easily computed. How does one determine the 
eigenvalues? By Theorems 10 of Sect. 8.3 and 8 of Sect. 8.4, 5 is an eigenvalue if 
and only if 

det(s] — A) = 0. (3) 
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As a function of s, we let c4(s) = det(sI — A); it is called the characteristic 
polynomial of A, for it is a polynomial of degree n (assuming A is ann xn 
matrix). The matrix sJ — A is called the characteristic matrix, and (3) is called 
the characteristic equation. By solving the characteristic equation, we determine 
the eigenvalues. 


Example 2. Determine the characteristic polynomial, c4(s), for 


=3 1 
eed 
-42 


as given in Example 1. Find the eigenvalues and corresponding eigenspaces. 


> Solution. The characteristic matrix is 


=| 
Fae a 
45-2 


and the characteristic polynomial is given as follows: 
3-1 
ee aaer =a) ase? 
45-2 
= (s +3)(s—2)+4=s?+5-2= (5+ 2)(s- 1). 


The characteristic equation is (s + 2)(s— 1) = 0, and hence, the eigenvalues are —2 
and 1. The eigenspaces, E,, are computed as follows: 


E_»: We let s = —2 in the characteristic matrix and row reduce the corresponding 
augmented matrix [-27 — A|0] to get the null space of —27 — A. We get 


1 —1/0 1 —1/0 
t2(—4) : 

4-4/0} __, |0 0)0 
If x and y are the variables, then y is a free variable. Let y = a. Thenx = y =a. 


From this, we see that 
1 
E_»= spn Hi : 


E,: We let s = 1 in the characteristic matrix and row reduce the corresponding 
augmented matrix [1/ — A|0] to get the null space of 17 — A. We get 
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4 —-1)0 1 -1/4)0 1 -1/4/0 
m,(1/4) t12(—4) 

4-1/0; __, |4 -—1]0] —__, |0 0|0 

Again y = a is the free variable and x = ia. It follows that the null space of 


1/4 


1J — A is all multiples of the vector + Since we are considering all multiples 


of a vector, we can clear the fraction (by multiplying by 4) and write 


<om([] 


We will routinely do this. < 
2 é 
Remark 3. In Example |, we found that the vector vy) = : was an eigenvector 
tones 1 . 1 
with eigenvalue 1. We observe that v; = 2 € EF). In like manner, v2 = € 
4 1 


E_». 


Example 4. Determine the characteristic polynomial for 


3-11 
A=/3-1 3 
1-13 


Find the eigenvalues and corresponding eigenspaces. 


> Solution. The characteristic matrix is 


3 1 -l 
sI-A=]—35+4+1 -3], 
—1 1ls-—3 


and the characteristic polynomial is calculated by expanding along the first row as 
follows: 
s—3 1 -l 
det(sf —A)=det] -—35+1 -3 
-1 1s—3 
(s — 3)((s + 1)(s — 3) +3) — (3(s — 3) —3) —(-3 +54) 


II 


ca(s) 


II 
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= s? — 5s? + 8s —4 = (s — 1)(s —2)’. 
It follows that the eigenvalues are 1 and 2. The eigenspaces, E;, are computed as 
follows: 


FE: We let s = 1 in the characteristic matrix and row reduce the corresponding 
augmented matrix [J — A|0]. We forego the details but we get 


1 0-1/0 
0 1 —3]0 
00 oo 


If x, y, and z are the variables, then z is the free variable. Let z = a. Then x = a, 
y = 3a, and z = a. From this, we see that 


1 
FE, = Span 4 | 3 
1 


Ey: We let s = 2 in the characteristic matrix and row reduce the corresponding 
augmented matrix [2/ — A|0] to get 


1 —1 1/0 
0 00j)0 
0 00)0 


Here we see that y = a and z = f are free variable and x = a — f. It follows that 
the null space of 27 — A is 


1 —l 
Ey = Span 1], 0 ; < 
0 1 


For a diagonal matrix, the eigenpairs are simple to find. Let 


i=) 


a De 


0 a 


j=) 


A= diag(a|,...,dn) = 
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Let e; be the column vector in R” with 1 in the ith position and zeros elsewhere; e; 
is the ith column of the identity matrix J,. A simple calculation gives 
Ae; = ajej. 

Thus, for a diagonal matrix, the eigenvalues are the diagonal entries and the 
eigenvectors are the coordinate axes in R”. In other words, the coordinate axes point 
in the directions for which A scales vectors. 

If A is a real matrix, then it can happen that the characteristic polynomial have 
complex roots. In this case, we view A a complex matrix and make all computation 


over the complex numbers. If C” denotes the n x 1 column vectors with entries in 
C, then we view A as transforming vectors v € C” to vectors Av € C”. 


Example 5. Determine the characteristic polynomial for 


a=[P 


Find the eigenvalues and corresponding eigenspaces. 


> Solution. The characteristic matrix is 


and the characteristic polynomial is given as follows: 


ca(s) = det(sJ — A) = det ee : 
-ls+2 
= (s—2)(s+24+5=s? +1. 


The eigenvalues are +i. The eigenspaces, E,, are computed as follows: 


E;: We let s = i in the characteristic matrix and row reduce the corresponding 
augmented matrix [iJ — A|0]. We get 


i-2 5 |0 Pi2 1 -i-2 
—-1 1+2)0 m(-1) |i —2 5 
— 


1-i-2 
t12(—(@—2)) 
— 


If x and y are the variables, then y is a free variable. Let y = a. Then x = a(i +2). 
From this, we see that 
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i +2 
E; = Span < 
1 
E_;: We let s = —i in the characteristic matrix and row reduce the corresponding 
augmented matrix [—i/ — A|0]. We get 
-i-2 5 0 Pi2 1 i—2)|0 
—1 -i+2)0) mip ]-i-2 5 0 
wa 


k pas 
t)2(i+2) 
satel 0 0 


0 
al? 
Again y = a is the free variable and x = (2 —i)a. It follows that 


com 


Remark 6. It should be noted in this example that the eigenvalues and eigenvectors 
are complex conjugate of one another. In other words, if s = 7 is an eigenvalue, 


/ we F : i+2]. : : 
then s = —i is another eigenvalue. Further, if v = a is an eigenvector with 
1 
eigenvalue 7, then V = a is an eigenvector with eigenvalue i = —i and 
1 


vice versa. The following theorem shows that this happens in general as long as A is 
areal matrix. Thus, E_; may be computed by simply taking the complex conjugate 
of E ie 


Theorem 7. Suppose A is a real n x n matrix with a complex eigenvalue s. Then s 
is an eigenvalue and 


Proof. Suppose s is a complex eigenvalue and v € E, is a corresponding 
eigenvector. Then Av = sv. Taking complex conjugates and keeping in mind that 
A = A since A is real, we get AV = Av = sv = 5 ¥. It follows that ¥V € Es and 
C E;. This argument is symmetric so E; C E,. These two statements imply 


Ey 
Es => Es. oO 


626 8 Matrices 


8.5 Eigenvectors and Eigenvalues 627 
Exercises 


1-7. For each of the following matrices A determine the characteristic polynomial, 
the eigenvalues, and the eigenspaces. 


8-13. For the following problems, A and its characteristic polynomial are given. 
Find the eigenspaces for each eigenvalue. 


102 

8. A= |9 -7 9],ca(s) = (6 + IGS 1s - 2) 
5-46 
| 8 —5 5] 

9 A= 0-2 0}. ca(s) = (s + 2)?(s — 3) 
|-10 5 —7| 
1 1-1 

10. A=|]0-1 4],ca(s) = (8-1)? —-3) 
0-2 5 


628 


2 00 
11. A=] 2 —3 6], ca(s) = s(s — 2)(s — 3) 
1 —3 6 
—6 11-16 
12.A=| 4 -4 8|,ca(s) = (6-2) 
7-10 16 
—8 13-19 
13.A=| 8 -8 14], ca(s) = (—2)(s? —45 45) 


11-14 22 
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Chapter 9 
Linear Systems of Differential Equations 


9.1 Introduction 


In previous chapters, we have discussed ordinary differential equations in a single 
unknown function, y(t). These are adequate to model real-world systems as they 
evolve in time, provided that only one state, that is, the number y(t), is needed 
to describe the system. For instance, we might be interested in the temperature 
of an object, the concentration of a pollutant in a lake, or the displacement of a 
weight attached to a spring. In each of these cases, the system we wish to describe 
is adequately represented by a single function of time. However, a single ordinary 
differential equation is inadequate for describing the evolution over time of a system 
with interdependent subsystems, each with its own state. Consider such an example. 


Example 1. Two tanks are interconnected as illustrated below. 


3 gal/min 


Tank1 Tank2 


Assume that Tank | contains 10 gallons of brine in which 2 pounds of salt are 
initially dissolved and Tank 2 initially contains 10 gallons of pure water. Moreover, 
the mixtures are pumped between the two tanks, 4 gal/min from Tank | to Tank 


W.A. Adkins and M.G. Davidson, Ordinary Differential Equations, 629 
Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-3618-8_9, 
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2 and 1 gal/min going from Tank 2 back to Tank 1. Assume that a brine mixture 
containing | Ib salt/gal enters Tank | at a rate of 3 gal/min, and the well-stirred 
mixture is removed from Tank 2 at the same rate of 3 gal/min. Let y(t) be the 
amount of salt in Tank | at time ¢ and let y2(t) be the amount of salt in Tank 2 at 
time ¢. Determine how y; and y2 and their derivatives are related. 


> Solution. The underlying principle is the same as that of the single tank mixing 
problem. Namely, we apply the balance equation 


y(t) = input rate — output rate 


to the amount of salt in each tank. If y,(t) denotes the amount of salt at time ¢ in 
Tank 1, then the concentration of salt at time ¢ in Tank 1 is c)(t) = (91 (¢)/10) 
Ib/gal. Similarly, the concentration of salt in Tank 2 at time ¢ is c2(t) = (y2(t)/10) 
lb/gal. The input and output rates are determined by the product of the concentration 
and the flow rate of the fluid at time ¢. The relevant rates of change are summarized 
in the following table. 


From To Rate 
Outside Tank 1| (1 lb/gal) - (3 gal/min) = 3 Ib/min 
t 
Tank1 Tank? i“ 1 tbjgal- 4 gal/min = ae “ ) tbymin 


t 
Tank2 = Tank 1 ss a 2D ibjgal- 1 gal/min = ~ nt) ) Silent 


an 3y2(t) 


Tank 2 Outside Ib/gal - 3 gal/min = 10 


Ib/min 


The data for the balance equations can then be read from the following table: 


Tank Input rate Output rate 
ya(t) 4yi(t) 
1 3 
a 10 10 
» 4yi(t) Aya(t) 
10 10 


Putting these data in the balance equations then gives 


4 1 

((t) = ——yilt —yo(t 3, 

y(t) 1921) + 7072) 2 
4 4 

S(t) = —y (t) — —yo(t). 

y(t) 10) 16 ) 19224 ) 


These equations thus describe the relationship between y; and y2 and their 
derivatives. We observe also that the statement of the problem includes initial 
conditions, namely, y,(0) = 2 and y2(0) = 0. < 
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These two equations together comprise an example of a (constant coefficient) 
linear system of ordinary differential equations. Notice that two states are involved: 
the amount of salt in each tank, y(t) and y2(t). Notice also that y| depends not 
only on y; but also y2 and likewise for y,. When such occurs, we say that y; and 
yz are coupled. In order to find one, we need the other. This chapter is devoted to 
developing theory and solution methods for such equations. Before we discuss such 
methods, let us lay down the salient definitions, notation, and basic facts. 
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9.2 Linear Systems of Differential Equations 


A system of equations of the form 
WO= anOnOQ) +: +anOQynO + AO 
yx(t) = aai(t)yi(t) +++ + aan) yn®) + AO) 
(1) 
y(t) = au(t)yi(t) + +++ + ann) yn) + fa2), 


where a;;(t) and /;(t) are functions defined on some common interval, is called 
a first order linear system of ordinary differential equations or just linear 
differential system, for short. If 


yilt) a(t) +++ din(t) fi(t) 
yO=ul :], 4@=] 2 tfeand FO=] 
yn(t) An(t) +++ dnn(t) fr(t) 
then (1) can be written more succinctly in matrix form as 
YO=AYYOH +f. (2) 
If A(t) = A is a matrix of constants, the linear differential system is said to 


be constant coefficient. A linear differential system is homogeneous if f = 0; 
otherwise it is nonhomogeneous. The homogeneous linear differential system 
obtained from (2) (equivalently (1)) by setting f = 0 (equivalently setting each 
fi(t) = 0), namely, 


y = A(tyy, (3) 
is known as the associated homogeneous equation for the system (2). 
As was the case for a single differential equation, it is conventional to suppress 
the independent variable ¢ in the unknown functions y; (¢) and their derivatives y/(t). 
Thus, (1) and (2) would normally be written as 


yi = an(t)yi tet an(Hyn t+ A 


= ani (t)y1 +++) + don(t)yn + fot) 
(4) 
Ye = Ani(t)yr tee + dan(t)yn + fn), 
and 
y’ = Alt)y + f(t), (5) 


respectively. 
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Example 1. For each of the following systems, determine which is a linear 
differential system. If it is, write it in matrix form and determine whether it is 
homogeneous and whether it is constant coefficient: 


1. 
yy =A-4y1 + ey. + (Sint)y3 + 1 
yy = 3y, + ty2 + (cost)y3 + te 
y= y3 
2: 
yi = ay: — by y2 
yy = —cy; + dyiy2 
3. 
j 4 1 
Sa a age 
4 4 


/ 


y2 = io”! ~ 70 
> Solution. 1. This is a linear differential system with 


y2 


1—t e' sint 1 
A(th=] 3 t cost| and f(t) = | te 
0) 0) 1 0 


Since f 0, this system is nonhomogeneous, and since A(t) is not a constant 
function, this system is not a constant coefficient linear differential system. 

2. This system is not a linear differential system because of the presence of the 
products y; y2. 

3. This is a linear differential system with 


all 
"| and f= He 
—4 0 


It is constant coefficient but nonhomogeneous. This is the linear differential 
system we introduced in Example | of Sect. 9.1. < 


A(t) = A= ; 


If all the entry functions of A(t) and f(t) are defined on a common interval, J, 
then a vector function y, defined on /, that satisfies (2) (or, equivalently, (1)) is a 
solution. A solution of the associated homogeneous equation y’ = A(t)y of (2) 
is referred to as a homogeneous solution to (2). Note that a homogeneous solution 
to (2) is not a solution of the given equation y’ = A(t)y-+/f (t), but rather a solution 
of the related equation y’ = A(t)y. 


Example 2. Consider the following first order system of ordinary differential 
equations: 


y, =3y1-y2 
ys = 4y1 — 2yo. (6) 
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Let 
2t =f 
y= ia and z(t) = pale 


Show that y(t), z(t), and w(t) = cy y(t) + coz(t), where c; and cz are scalars, are 
solutions to (6). 


> Solution. Let A = li I Then (6) can be written 


This system is a constant coefficient homogeneous linear differential system. For 
2t 


y(t) = a we have on the one hand 
e 


2t 
yi = [35 


and on the other hand, 
3-1] fe? 3e7? — @?! 2e*! 
yf) |: | a fe — 2" | ~ | 20% 


It follows that y’ = Ay, and hence, y is a solution. 
=f 


For z(t) = pel we have on the one hand 


Z() = ee 


and on the other hand, 


Ay = 3 -1 e‘|  |3e%—4e*] | -e™ 
14 -—2|[4e*]> [4e*-—8e tt} |—4e*]° 
Again, it follows that z is a solution. 
Suppose c; and cz are any constants and w(t) = ciy(t) + coz(t). Since 


differentiation is linear, we have w(t) = cy,y’(t) + Coz/(t). Since matrix 
multiplication is linear, we have 


Aw(t) = cAy(t) + cr Az(t) = cry’(t) + c22’(t) = w'(t). 


It follows that w(t) is a solution. < 
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Example 3. Consider the following first order system of ordinary differential 
equations: 


Yi = 391 — yo + 2t 
ys = 4y1 —2y2 +2. (7) 


—2t+1 


1. Verify that y,(¢) = 4t+5 


is a solution of (7). 
—4t+2 
—8t + 10 
3. Verify that y(t) = w(t) + y,(¢) is a solution of (7), where w(t) is the general 
solution of (6) from the previous example. 


2. Verify that Zp(t) = 2y,(t) = is not a solution to (7). 
> Solution. We begin by writing (7) in matrix form as: 

y =Aytf, 
4 -2 


differential system, that is, the equation y’ = Ay obtained by setting f = 0, is the 
system from the previous example. 


—2 
NGS 
yi(t) = |" A 
and on the other hand, 


—_ {3 -l}]—-2t+1 Qt} | 3(—-2t + 1) — (4 +5) +28 
Ay f= [5 =| Peer 2 ee i 


where A = : >| and f = 7): Note that the associated homogeneous linear 


1. On the one hand, 


Since Vp = Ay, + f, it follows that y,, is a solution to (7). 
2. On the one hand, 


and on the other hand, 


3 -1)[ 42427 [ar 
A = 
+f F >| Parle 
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4(—4t + 2) —2(-8r + 10) +2 
_ |-2t-4 
~ | -10 J! 
Since z # Az, + f., Zp is not a solution. 
3. Since y’ = Ay is the homogeneous linear differential system associated to (7), 


we know from the previous example that w is a solution to the homogeneous 
equation y’ = Ay. Since differentiation is linear, we have 


a be 49) = 8i 410) + S| 


Ye=wtY> 
= Aw+ Ay, +f 
=Awty,)+f 
= Ay,+ f. 
It follows that Ve is a solution to (7). < 


These two examples illustrate the power of linearity, a concept that we have 
repeatedly encountered, and are suggestive of the following general statement. 


Theorem 4. Consider the linear differential system 
y =Ay + f@. (8) 


1. If y, and y, are solutions to the associated homogeneous linear differential 
system 


y= A(tyy, (9) 


and c, and C2 are constants, then cy y, + C2y> is also a solution to (9). 
2. If y, is a fixed particular solution to (8) and y,, is any homogeneous solution 
(i.e., any solution to (9)), then 


Yh + Vp 
is also a solution to (8) and all solutions to (8) are of this form. 


Proof. Let L = D — A(t) be the operator on vector-valued functions given by 
Ly =(D- A())y = y'— Ay. 


Then L is linear since differentiation and matrix multiplication are linear. The rest 
of the proof follows the same line of argument given in the proof of Theorem 6 of 
Sect. 3.1. Oo 


Linear differential systems also satisfy the superposition principle, an analogue 
to Theorem 8 of Sect. 3.4. 
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Theorem 5. Suppose y ,, is asolution to y' = A(t)y + f(t) and y ,, isa solution 
toy’ = A(t)y + fo(t). Then y = y,,(t) + y ,,(t) is a solution to y' = A(t)y + 
Ai + fr). 


Proof. Let L = D — A(t) be as above. Then linearity implies 


L(y, + ¥p) =Ly,, + Ly, = fiO+ fo. Oo 


Initial Value Problems 


For a linear differential system y’ = A(t)y + f(t), assume the entries of A(t) and 
J (t) are defined on a common interval J. Let t9 €¢ J. When we associate to a linear 
differential system an initial value y(to) = yo, we call the resulting problem an 
initial value problem. The mixing problem we discussed in the introduction to this 
chapter is an example of an initial value problem: 


y=Ay+f, yO)=Yo, 


1 
eh f= fa ane 0) = Be 


10 


Linear Differential Equations and Systems 


For each linear ordinary differential equation Ly = f with initial conditions, we 
can construct a corresponding linear system with initial condition. The solution of 
one will imply the solution of the other. The following example will illustrate the 
procedure. 


Example 6. Construct a first order linear differential system with initial value from 
the second order differential equation 


y’+ty’+y=sint y(0)=1, y’'(0) =2. 


> Solution. If y(t) is a solution to the second order equation, form a vector 


20) by setting y(t) = y(r) and y2(t) = y'(t). Then 
2 


function y(t) = ? (t) 


y(t) = yO = yo), 
yx(t) = y"(t) = —y(@) — ty'(t) + sint = —yi(t) — ty2(t) + sint. 
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The second equation is obtained by solving y” + ty’ + y = sint for y” and 
substituting y, for y and y2 for y’. In vector form, this equation becomes 


y=AOy +f, 
0 1 0 1 
wwe a= [® "Lro=[2 Jaaro=[ P 
The solution to the first order differential system implies a solution to the original 
second order differential equation and vice versa. Specifically, if y = k | is a 


solution of the system, then the first entry of y, namely, y,, is a solution of the 
second order equation, and conversely, as illustrated in the above example, if y is 


a solution of the second order equation, then y = y is a solution of the linear 


/ 
system. 

Linear differential equations of order 1 are transformed into linear systems in a 
similar way. 


Extension of Basic Definitions and Operations to Matrix- Valued 
Functions 


It is convenient to state most of our results on linear systems of ordinary differential 
equations in the language of matrices. To this end, we extend several definitions 
familiar for real-valued functions to matrix-(or vector-)valued functions. Let v(t) be 
ann xm matrix-valued function with entries v;,;(¢), fori = 1...n andj =1...m. 


1. v(t) is defined on an interval J of R if each v;;(¢) is defined on /. 
2. v(t) is continuous on an interval J of R if each v;;(¢) is continuous on J. For 
instance, the matrix 


1 
— cos 2t 
v(t) = | £2 
—2t 
(2t — 3)? 
is continuous on each of the intervals J; = (—oo,—2), Ig = (—2,3/2) and 


I; = (3/2, 00), but it is not continuous on the interval [4 = (0, 2). 

3. v(t) is differentiable on an interval J of R if each v;;(¢) is differentiable on 
I. Moreover, v(t) = [aj;(¢)]. That is, the matrix v(t) is differentiated by 
differentiating each entry of the matrix. For instance, for the matrix 


t : 2 
un =| sint t ak 


Int cost sinht 
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we have 


jea= e! cost 2t 


1/t —sint cosht 


. An antiderivative of v(t) is a matrix-valued function V(t) (necessarily of the 
same size) such that V’(t) = v(t). Since the derivative is calculated entry by 
entry, so likewise is the antiderivative. Thus, if 


4t 


e sin t 
v(t) = 2t Int], 
cos 2t 5 
then an antiderivative is 
fe" +e  —cost+ cp 
vi = f var = +01 tint-—t+cy 
5sin 2t + c31 St + ¢32 
1 4t 
ae —cost 


II 


t? tint—t}]4+C, 
5sin 2t 5t 


where C is the matrix of constants [c;;]. Thus, if v(t) is defined on an interval J 
and V(t) and V(t) are two antiderivatives of v(t), then they differ by a constant 
matrix. 

. The integral of v(t) on the interval [a, b] is computed by computing the integral 
of each entry of the matrix over [a, b], that is, te v(t) dt = [I vi (t) dv. For 


the matrix v(t) of item 2 above, this gives 


1 1 
1 
1 / Po dt i COs 2t dt In ; 5 sin 2 
0 1 $(1 = e~?) 1 


1 1 
e 2! dt i ———_ dt 3 
i 90 (2t—3)/ 


. If each entry v(t) of v(t) is of exponential type (recall the definition on 
page 111), we can take the Laplace transform of v(t), by taking the Laplace 
transform of each entry. That is, L(v(t))(s) = [LO (t))(s)]. For example, if 


tet 
ie e cos 2t 


this gi 
e*sint (2t— ‘| ee 


Lite) (s)  L(cos2t)(s) — 4 
L(v(t))(s) = ( > ha eer 
L(e* sint)(s) £ ((2t — 3)) (s) Sa ae 
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7. We define the inverse Laplace transform entry by entry as well. For example, if 


ole. <2 
V(s) = i eee 
44 (144 


then 


cos2t e! sin2t 


LIV} @) = bee ne iF 


8. Finally, we extend convolution to matrix products. Suppose v(t) and w(t) are 
matrix-valued functions such that the usual matrix product v(t)w(t) is defined. 
We define the convolution v(t) * w(t) as follows: 


(0) *wO)i7 = Do vie * we sO). 
k 


Thus, in the matrix product, we replace each product of terms by the convolution 
product. For example, if 


e! e2t 3e! 
v(t) = ie 4 and w(t) = Bee 


e2t 3e! 
[eae] 
3e’ xe’ —e*% xe 
-|_ 3e7! x ef — 2e! “] 
3te’ — (e# —e’) 

i 3(e?" — e') — A 


then 


vx w(t) = 


II 


te’ |_| + (e7 —e’) e ; 
Alternately, if we write 


v(t) =e F ; +e E “| and w(t) =e! HH : 


then the preceding calculations can be performed as follows: 


ven = (e F 2] E al) *2 |] 
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eel alah aco l 
= te! | + (e7 —e') es : 


The following theorem extends basic operations of calculus and Laplace trans- 


forms to matrix-valued functions. 


Theorem 7. Assume v(t) and w(t) are matrix-valued functions, g(t) is a real- 
valued function, and A is a matrix of constants. 


1, 


Suppose v is differentiable and the product Av(t) is defined. Then Av(t) is 
differentiable and 
(Av(t))’ = Av‘(t). 


. Suppose v is differentiable and the product v(t)A is defined. Then v(t)A is 


differentiable and 
(v(t)AY =V(t)A. 


. Suppose the product, v(t)w(t), is defined and v and w are both differentiable. 


Then 
(Ow)! = Vw) + Ow". 


. Suppose the composition v(g(t)) is defined. Then (v(g(t)))’ = v'(g(t))g'(t). 
. Suppose v is integrable over the interval [a, b] and the product Av(t) is defined. 


Then Av(t) is integrable over the interval [a,b] and 


i Av(t) dt = af v(t) df. 


. Suppose v is integrable over the interval [a, b] and the product v(t)A is defined. 


The v(t)A is integrable over the interval |a, b| and 


i v(t)Adt = (/ vat A. 


. Suppose v(t) is defined on [0,00), has a Laplace transform, and the product 


Av(t) is defined. Then Av(t) has a Laplace transform and 


LiAv(t)} (s) = AL tv(1)} (5). 


. Suppose v(t) is defined on [0, 00), has a Laplace transform, and the product 


v(t)A is defined. Then v(t)A has a Laplace transform and 


Liv(t)A} (s) = (Liv@)} (s)) A. 
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9. Suppose v(t) is defined on [0, 00) and v'(t) exists and has a Laplace transform. 
Then 


LAV} (s) = sLAV(O} (s) — vO). 


10. The convolution theorem extends as well: Suppose v(t) and w(t) have Laplace 
transforms and v * w(t) is defined. Then 


Liv * w(t)} (8) = Ltt} (s) - Ltw(0)} (9). 


Remark 8. Where matrix multiplication is involved in these formulas it is impor- 
tant to preserve the order of the multiplication. It is particularly worth emphasizing 
this dependency on the order of multiplication in the product rule for the derivative 
of the product of matrix-valued functions (formula (3) above). Also note that 
formula (4) is just the chain rule in the context of matrix-valued functions. 
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9.2 Linear Systems of Differential Equations 645 
Exercises 


1-6. For each of the following systems of differential equations, determine if it is 
linear. For each of those which are linear, write it in matrix form; determine if the 
equation is (1) homogeneous or nonhomogeneous and (2) constant coefficient. Do 
not try to solve the equations. 


4 = 
Yo = Yiy2 


re WNty+e? 
Yy=—yityot 1 


II 


3. y, = (sint)y1 


yy = yi + (cost)y2 
if y, =tsiny) — yo 
= yi + fos yo 
y= 
5 yy = 2y + y4 
y= ya 
Ye= yr +2y3 
| 
Y= svi - yot5 
6. 2 1 
yy = Ml ya 9 


yilt) 


ya(t) 
given linear differential system with the given initial value. 


,_ [5 -2].. _ [0 _[ e&-e* 
by -[; Me vo=|"), vO=[,2 a 


,_ {3 -l] _ {i .. |e +2 
=|) ae vo =|5). vo=| al 


7-10. Verify that the given vector function y(t) = is a solution to the 


pale = e |. _ {i _ | et+te' 
y =[3 ol + [8] vo =[5). yO=[o0 tt 
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10. 


0 1 t 1 1—f+2sint 
y=[ oly+[ 4]: vo = [1]. v= | Te tal: 


11-15. Rewrite each of the following initial value problems for an ordinary 
differential equation as an initial value problem for a first order system of ordinary 
differential equations. 


11. y” +5y’+6y =e, y(0)=1, y’(0) = 2. 
12. y’+k?y=0, y(0)=-1,y’(0) =0 

13. y’—k’?y = Acosat, y(0)=0, y’(0) =0 
14. ay” +by'’+cy=0, y(0)=a, y’(0)=86 
15. t?y"4+2ty’+y=0, yl) =-2, y(1) =3 


16-21. Compute the derivative of each of the following matrix functions. 


16. A(t) = aba sin 2t 
—sin2t cos2t 
et t 
17. A(t) = 2 | 
e te? fe7 
18. A(t) = 0 e* tet 
0 0 e! 
t 
= 2 
19. y(t) =] ¢ 
Int 
20. A(t) = E A 


21. v(t) =[e* In(t? +1) cos3e] 


22-25. For each of the following matrix functions, compute the requested integral. 


cos2t sin a 


22. Compute f,? A(t) dr it aw) =| ee ate 


; 1 [et 4672 92 — 6-2 
23. Compute f, A(t) dt if A(t) = a | tee a 
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t 
24. Compute i. y()drify(t)=| 2 
Int 


25. Compute f? A(t) dr if A(t) = ; A 


26. On which of the following intervals is the matrix function A(t) = 
t (t + 1)7! 


continuous? 
(¢-1)? ¢+6 


@ A=) b) b=(@0,0) © 8=(-1,0) 
dd) Iy=(-o0,-1) ©) 15 =(,6) 


27-32. Compute the Laplace transform of each of the following matrix functions. 


27. A(t) = E Z| 


28. A(t) = | cos t [| 
sint cost 
te tsint te? 
29. A(t) = 
eae a - ecos2t 3 
30. A(t) = 
1 -l -l 1 
ae —t 
31. neil i|+e \ 4 
1 sint 1-—cost 
32. A(t)=|0 cost sin t 
O —sint cost 


33-36. Compute the inverse Laplace transform of each matrix function: 


648 


35. 


36. 


2s 2 
s—1] s2-1 
2 2s 
s2—1  s2-]1 
1 1 
sl s?—2s4+1 
4 1 
s3 + 25? — 3s s+ 
35 1 
s?+9 s—3 
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9.3. The Matrix Exponential and Its Laplace Transform 649 
9.3. The Matrix Exponential and Its Laplace Transform 


One of the most basic Laplace transforms that we learned early on was that of the 
exponential function: 
1 
Ciel!) = (1) 


sS-a 


This basic formula has proved to be a powerful tool for solving constant coefficient 
linear differential equations of order n. Our goal here is to extend (1) to the case 
where the constant a is replaced by an n x n matrix A. The resulting extension 
will prove to be an equally powerful tool for solving linear systems of differential 
equations with constant coefficients. 

Let A be ann Xn matrix of scalars. Formally, we define the matrix exponential, 
e4', by the formula 


Big ogee EE en. (2) 
2! 3! 
When A is a scalar, this definition is the usual power series expansion of the 
exponential function. Equation (2) is an infinite sum of m x n matrices: The first 
term J is then xn identity matrix, the second term is the n x n matrix Af, the third 
term is the m x n matrix and so forth. To compute the sum, one must compute 
each (i, j) entry and add the corresponding terms. Thus, the (i, /) entry of e’ is 


2: 
1 = (Diy HHA + GAG FO (3) 


which is a power series centered at the origin. To determine this sum, one must be 
able to calculate the (i, 7) entry of all the powers of A. This is easy enough for 
I = A®° and A = Al. For the (i, j) entry of A”, we get the ith row of A times 
the jth column of A. For the higher powers, A?, A‘, etc., the computations become 
more complicated and the resulting power series is difficult to identify, unless A 
is very simple. However, one can see that each entry is some power series in the 
variable ¢ and thus defines a function (if it converges). In Appendix A.4, we show 
that the series in (3) converges absolutely for all t € R and for all matrices A so that 
the matrix exponential is a well-defined matrix function defined on R. However, 
knowing that the series converges is a far cry from knowing the sum of the series. 
In the following examples, A is simple enough to allow the computation of e“’. 


2 0 0 
Example 1. LetA=|]0 3 0]. Compute e”. 
0 0 -!l 
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> Solution. In this case, the powers of the matrix A are easy to compute. In fact 


2 O 400 2” 0 0 
ASO 3. O59) At Oo On ey, APSO Be 
O04 001 6.6: 14 
so that 
At 1 55 1 33 
e'=1+At+-At+—At 4+::: 
2 3! 
1 00 2 0 ile. 2-9 fp Fe 203 0 
=/0 1 0O/+]0 3 OJ@+5/0 9 Of +510 27 O01 e 4: 
001 OG: 50s] "10 0 1 * de Hike Sh 
1426+ 4+ 0 0 
= 0 1430+ 4 0 
0 0 lire hye. 
e 0 O 
— 3t 
=/]0 e 0 « 
0 0 ef 


0 


Example 2. Let A = k 


Al Compute e“’. 


> Solution. In this case, A? = E “| lo | — lo Ol = Oand A” = 0 for all 


n > 2. Hence, 
At 1 22 1 33 
e Sal at aga tee 


=I1+At 


Note that in this case, the individual entries of e4’ are not exponential 
functions. < 


Example 3. Let A = 5 Al Compute e“”. 
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> Solution. The first few powers of A are A* = ie Al A = Fi ze 


0 1 
4. Thus, 


A= F Hl = 15, A> = A, A® = A’, etc. That is, the powers repeat with period 


1 1 
e! = 7+ At+ idee eae 


1 0 0 ¢],1[- oo], 1fo -#], lft 0 
=(j cae otal 0 -eltale stale Plat 


1-4P +44. t-tPh4+ 4h 4-- 


_ 53). V8 he sss — 1,24 1544... 
t+ yt Au + 1 xf + at + 
_ cost sint 
~ |—sint cost} 


(cf. (3) and (4) of Sect. 7.1). In this example also, the individual entries of e“’ are 
not themselves exponential functions. < 


Do not let Examples 1-3 fool you. Unless A is very special, it is difficult to 
directly determine the entries of A” and use this to compute e“’. In the following 
subsection, we will compute the Laplace transform of the matrix exponential 
function. The resulting inversion formula provides an effective method for explicitly 
computing e“’, 


The Laplace Transform of the Matrix Exponential 


Let A be an nm x n matrix of scalars. As discussed above, each entry of e4 
converges absolutely on R. From a standard theorem in calculus, we have that e“’ is 
differentiable and the derivative can be computed termwise. Thus, 


d 4, 4d Ar Abt 
—e" = —{(7+At+ + =F sate 


dt dt 2! 3! 
a At Abt? ~~ At 
7 1! + 2! 3! - 
Ar Ar 
= (1 + At + TT + ar i) 
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By factoring A out on the right-hand side in the second line, we also get 


aa =e, 
dt 
Appendix A.4 shows that each entry is of exponential type and thus has a Laplace 
transform. Now apply the derivative formula 


d 
Baie eft -A et 

dt 
and the first derivative principle for the Laplace transform of matrix-valued func- 
tions (Theorem 7 of Sect. 9.2) applied to v(t) = e”’, to get 


AL fe = Ll Ae) = £ a"| = she} —1, 


where we have used v(0) = e“'|;=9 = 7. Combining terms gives 
(SI —A)L{e“=1 
and thus, 


L{eM\ = (91 — A). 


This is the extension of (1) mentioned above. We summarize this discussion in the 
following theorem. 


Theorem 4. Let A be ann x n matrix. Then e' is a well-defined matrix-valued 
function and 


£ {eM = (sI — A)". (4) 


The Laplace inversion formula is given by 
“= fc} {(sI - A)"'} : (5) 


The matrix (sf — A)! is called the resolvent matrix of A. It is a function 
of s, defined for all s for which the inverse exists. Let c4(s) = det(sJ — A). 
It is not hard to see that c4(s) is a polynomial of degree n. We call c4(s) the 
characteristic polynomial of A. As a polynomial of degree n, it has at most n 
roots. The roots are called characteristic values or eigenvalues of A. Thus, if 
s is larger than the absolute value of all the eigenvalues of A then s/J — A is 
invertible and the resolvent matrix is defined. By the adjoint formula for matrix 
inversion, Corollary 11 of Sect. 8.4 each entry of (sJ — A)~! is the quotient of a 
cofactor of sJ — A and the characteristic polynomial c4(s), hence, a proper rational 


function. Thus, e“’ is a matrix of exponential polynomials. The Laplace inversion 
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formula given in Theorem 4 now provides a method to compute explicitly the matrix 
exponential without appealing to the power series expansion given by (2). It will 
frequently involve partial fraction decompositions of each entry of the resolvent 
matrix. Consider the following examples. 


3 
—2 
use the Laplace inversion formula to compute e“’. 


Example 5. Let A = ‘| . Compute the resolvent matrix (sJ — A)~! and 


> Solution. The characteristic polynomial is 
ca(s) = det(sJ — A) 


ee | a —4 
2 s+3 


(s—3)(s +3) +8 
= s§?-1=(s—1)(s+ 1). 


II 


The adjoint formula for the inverse thus gives 


-1 _ 1 s+3 4 
ee | al 
s+3 4 
(s—1)(s+1) (s—1)(s4+1) 
—2 s—3 


(s—l1)(s+1) (s—1)(s4+1) 


1 2 2 4 1 [-1 -2 
s-1|{-1 -1l sti, 1 2]? 
where the third line is obtained by computing partial fractions of each entry in the 
second line. 


To compute the matrix exponential, we use the Laplace inversion formula from 
Theorem 4 to get 


II 


w= lL {Gl=aAy} 


el 2 2) 4 ot =[ — 
"1-1 <1 1 2 


_ | 2e-e* 2e' —2e7 
~ Jae tet el + 2e7# 


As a second example, we reconsider Example 3. 
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Example 6. Let A = , 0| . Compute the resolvent matrix (sJ — A)~! and use 


the Laplace inversion formula to compute e“’. 


> Solution. The characteristic polynomial is 


ca(s) = det(sJ — A) 


= det I; — 
1 RY 
— ae ee 


The adjoint formula for the inverse thus gives 


Ce E 4 


s2?+1 Ss 
Ss 1 
_— | s?+1 s?41 
~ -1 s 
set] s24+1 


Using the inversion formula, we get 
a = fo} {(sI - A)'} 


cost sint 
= . , < 
—sint cost 


Theorem 4 thus gives an effective method for computing the matrix exponential. 
There are many other techniques. In the next section, we discuss a useful alternative 
that circumvents the need to compute partial fraction decompositions. 
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Exercises 


1-7. Use the power series definition of the matrix exponential to compute e“’ for 
the given matrix A. 


L4=[) 5] 
0 -2 


2.A= E 33] 
5 3 


Noo oO 


0 1 
7,.A=]-1 0 
0 0 

8-13. For each matrix A given below 


(i) Compute the resolvent matrix (sJ — A)~!. 
(ii) Compute the matrix exponential e4’ = £7! {(sI - A) }. 


11. A= 


12. 
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14. Suppose A = i | where M is anr x r matrix and N is ans x s matrix. 


Mt 
Show that e4’ = ee PA 


15-16. Use Exercise 14 to compute the matrix exponential for each A. 


0 1 0 
15. A=]-1 0 0 
0 0 2 
1 1 0 0 
(6-a= 1 1 0 0 
0 0 1 -l 
0 0 —2 2 
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9.4 Fulmer’s Method for Computing e“’ 


The matrix exponential is fundamental to much of what we do in this chapter. 
It is therefore useful to have efficient techniques for calculating it. Here we will 
present a small variation on a technique! due to Fulmer? for computing the matrix 
exponential, e“’. It is based on the knowledge of what types of functions are included 
in the individual entries of e“’. This knowledge is derived from our understanding 
of the Laplace transform formula 


et = £7" {(sI — AD}. 


Assume that A is an 7 Xx n constant matrix. Let c4(s) = det(sJ — A) be the 
characteristic polynomial of A. The characteristic polynomial has degree n, and by 
the adjoint formula for matrix inversion, c4(s) is in the denominator of each term of 
the inverse of s] —A. Therefore, each entry in (s! — A)! belongs to R, ,, and hence, 
each entry of the matrix exponential, e4’ = £7! { (sf — Ay", is in €,. Recall 
from Sects. 2.6 and 2.7 that if g(s) is a polynomial, then 7, is the set of proper 
rational functions that can be written with denominator q(s), and €, is the set of all 
exponential polynomials f(t) with L{f(t)} € Ry. If Be, = {¢1, do, ..., Gn} is 
the standard basis of €,,, then it follows that 


A 
e i Mid Seer Mndn, 
where M; is ann xX n matrix for each index i = 1,...,n. Fulmer’s method is a 
procedure to determine the coefficient matrices Mj,..., My. 


Before considering the general procedure and its justification, we illustrate 
Fulmer’s method with a simple example. If 


then the characteristic polynomial is 


ca(s) = det(sf — A) = s*-—2s+2=(s—1)°+1 


'There are many other techniques. For example, see the articles “Nineteen Dubious Ways to 
Compute the Exponential of a Matrix” in Siam Review, Vol 20, no. 4, pp 801-836, October 1978 
and “Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later” 
in Siam Review, Vol 45, no. 1, pp 3-49, 2003. 

?Edward P. Fulmer, Computation of the Matrix Exponential, American Mathematical Monthly, 82 
(1975) 156-159. 
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and the standard basis is B., = {e' cost, e’ sint}. It follows that 
e“’ = Mie! cost + Moe’ sint. 
Differentiate (1) to get 
Ae“ = M,(e! cost — e! sint) + M(e! sint + e! cost) 
and evaluate (1) and (2) at t = 0 to get the system 


I=M, 
A=M,+ M2. 


1 0 
0 1 
Substituting these matrices into (1) gives 


et = le 4 e cost + | : | e’ sint 


_ ° sint + 2e' cost Se’ sint 


It is immediate that M, = J = 


—e’ sint e’ sint — 2e! cost 


Compare the results here to those obtained in Exercise 11 in Sect. 9.3. 


| ana mts = Aa =A-TI -| : 


(1) 


(2) 


The General Case. Let A be an n x n matrix and c,(s) its characteristic 
polynomial. Suppose B., = {¢1,...,¢n}. Reasoning as we did above, there are 


matrices M,,..., M,, so that 


eM = M,¢\(t) SPsassk Mon (t). 


(4) 


We need to find these matrices. By taking n — 1 derivatives, we obtain a system of 


linear equations (with matrix coefficients) 


et = Midi (t) +--- + Midn(t) 
Ae“ = Mii (t) +--+ Mnd,(t) 


Atal eAt = Mg" Y(t) Henge M,¢6°—)(t). 


Now we evaluate this system at ¢ = 0 to obtain 
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A = Migi (0) +--+ + Mn di, (0) 
(3) 


A"! = Mygy" (0) ++ + MiG (0). 


At this point, we want to argue that it is always possible to solve (5) by showing 
that the coefficient matrix is invertible. However, in the examples and exercises, it 
is usually most efficient to solve (5) by elimination of variables. Let 


on (0) see On (0) 
WH=for 
tagger (0) . @—) (0) 
Then W is the Wronskian of ¢),...,¢, att = 0. Since ¢@), ..., dy are solutions 


to the linear homogeneous constant coefficient differential equation c4(D)(y) = 0 
(by Theorem 2 of Sect. 4.2) and since they are linearly independent (6,, is a basis 
of €,,), Abel’s formula, Theorem 6 of Sect. 4.2, applies to show the determinant of 
W is nonzero so W is invertible. The above system of equations can now be written: 


I M, 
A M> 
=W| . 
Ar} M,, 
Therefore, 
M, I 
M>, i A 
| =W 
M,, Atl 
Having solved for Mq,..., Mn, we obtain eft, 


Remark 1. Note that this last equation implies that each matrix M; is a polynomial 
in the matrix A since W~! is a constant matrix. Specifically, M; = p;(A) where 


1 


pi(s) = Row;(W~') 


n—1 
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The following algorithm outlines Fulmer’s method. 


Algorithm 2 (Fulmer’s Method). 


Computation of ce’ Where A Is a Given n x n Constant Matrix. 


. Compute the characteristic polynomial c4(s) = det(sI — A). 
. Determine the standard basis B., = {1,..., bn} of Ec,. 
3. We then have 


Ne 


eM! = Mio\(t) +--+ Midn(t) (6) 


where M; i = 1,...,n aren x n matrices. 

4. Take the derivative of (6) n — 1 times and evaluate each resulting equation 
at t = 0 to get a system of matrix equations. 

5. Solve the matrix equations for Mq,..., Mp. 


Example 3. Find the matrix exponential, e“’, if A = ; al 


> Solution. The characteristic polynomial is c4(s) = (s — 2)(s — 6) + 4 = 8? — 
8s + 16 = (s — 4). Hence, B,, = as te} and it follows that 


ec“! = Mie + Mote”. 
Differentiating and evaluating at f = 0 gives 


I=M, 
A=4M,+ M). 


It follows that 


1 O —2 | 
M, = = = _ = 3 
tol k i and M, = A-—4I & Al 


Thus, 
eft = Me" + Mote” 
1 Of} a, |-2 1) at 
= E 
lo ale [20 al 


_ fet! —2re* tett 
—4te! e+ 2te* 


As a final example, consider the following 3 x 3 matrix. 
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00 1 
Example 4. Find the matrix exponential, e“’, if A= |0 2 0 
1 0 0 


> Solution. The characteristic polynomial is 


Ss 0 -il 
ca(s) =det} O s—2 0) 
—l1 0 Ss 


mai copies ie 4 
= (s — 2)(s? — 1) = (s —2)(s — 1)(s + 1). 
It follows that B,, = {e7’,e’,e~"} and 
e“’ = Mie + Moe’ + Mae". 
Differentiating twice gives 
Ae“ = 2Mye*" + Moe’ — Mae" 
A’e™ = 4M ce" + Moe! + M3e" 
and evaluating at f = 0 gives 


1=M,+™M)+4+M; 
A=2M,+M,—M; 
A* = 4M, + Mo + M3. 


It is an easy exercise to solve for M,, Mz, and M3. We get 


00 0 
Por Copa 
00 0 
ye AOC 2 0 
oy = er 2 
ew __ (4-244 _ |? ° 
2 2 ; 
1 9 
ao A 2 0 
=344-9F (A=21D(4=4 2 
ive +21 _(4-2N4- _| 2 ? 
6 6 
—1 0 


NIE ONE 


NIE ONE 
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It follows now that 


e’ = eM, +e'M, +e '°M; 


cosht 0 _ sinht 
0 7! 0 : < 
sinht 0 cosht 


II 


9.4 Fulmer’s Method for Computing e“’ 


Exercises 


1-19. Use Fulmer’s method to compute the matrix exponential e“’. 


a 25 
10. A= 
oa=[ 2 
u. A= [7 1] 

so’ ad 


12. A= E 4] 
2 0O 


1 0 
13. A4=1]0 1. OJ], where cy(s) = s(s —1)(s +1) 
2 0 -—2 


3 -1 -1 
14. A= |. 1 , where c4(s) = (s — 1)?(s — 2) 


1 
0 
1 - 0 
15. A=] 1 —1]|, where c4(s) = (s — 1)(s? — 2s + 2) 
0 1 
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1 0 
2 1/1, where c4(s) = (s — 2)? 
1 2 


| 0 -—2], where c4(s) = (s — 1)(s? + 4) 
=.=) 2 
T -=2 
4 § = 
0 -2 
4 pa 


0 
: , where c4(s) = s?(s — 2)? 
2 

0 

1 

1 

1 


-l 1 1 

19. A= Pat , where c4(s) = (s? + 1)? 
—l 0 1 
0 -1l -l 


20-22. Suppose A is a 2 x 2 real matrix with characteristic polynomial c4(s) = 
det(s! — A) = s? + bs +c. In these exercises, you are asked to derive a general 
formula for the matrix exponential e“”. We distinguish three cases. 


20. Distinct Real Roots: Suppose c4(s) = (s —1r1)(s — rz) with r; and rz distinct 
real numbers. Show that 


ryt 


A—Prl 
et — 2 


A-rl 


r)—12 m™—T\ 


rot 
ee 


21. Repeated Root: Suppose c4(s) = (s — r)”. Show that 


ec’ = (14+ (A—-rl)t)e”. 


22. Complex Roots: Suppose c4(s) = (s — «)* + B* where B # 0. Show that 


(A—al) 
B 


e’ = Te“ cos Bt + e™ sin Bt. 
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9.5 Constant Coefficient Linear Systems 


In this section, we turn our attention to solving a first order constant coefficient 
linear differential system 


y=Aytf, Y(to) = Yo. (1) 


The solution method parallels that of Sect. 1.4. Specifically, the matrix exponential 
e 4’ serves as an integrating factor to simplify the equivalent system 


yay SJ: (2) 


The result is the existence and uniqueness theorem for such systems. As a corollary, 
we obtain the existence and uniqueness theorems for ordinary constant coefficient 
linear differential equations, as stated in Sects. 3.1 and 4.1. 

We begin with a lemma that lists the necessary properties of the matrix 
exponential to implement the solution method. 


Lemma 1. Let A be ann x n matrix. The following statements then hold: 


Le) oo =7. 
2. fe4t = Ae“ = e4'A for allt € R. 
3, eA@ta) = eAteda — eAtet for all t,a € R. 


: : . bs eg a -1 = 
4, &' is an invertible matrix with inverse (e“’) =e“ forallt €R. 


Proof. Items 1. and 2. were proved in Sect. 9.3. Fix a € R and let 
P(t) = e Ate ta) 
Then 


@'(t) = — Ae 4! Alita) 4 e4t 4eAtta) 


= —Ae AtgAU+a) 4 Ae At A(t a) = 0, 


which follows from the product rule and part 2. It follows that ® is a constant matrix 
and since (0) = e~4°e4* = e4@ by part 1, we have 


ee 4t Atta) = e144, (3) 


for all t,a € R. Now let a = 0 then e~4’e“! = J. From this, it follows that e“’ is 
invertible and (e“! y =e “'. This proves item 4. Further, from (3), we have 


eAta) = (eA oe = eAteda, 


This proves item 3. oO 
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To solve (1), multiply (2) by e~“’ to get 


e“y'(t)-e “ Ay) =e“ fn). (4) 


By the product rule and Lemma |, part 2, we have 


(eo “y)(t) = -e “ Ay(t) te“ y(t). 


We can thus rewrite (4) as 


(“yO =e“ FO. 


Now change the variable from f to u and integrate both sides from fg to f to get 


MyM y(n) = [eM yy wau= fm" Fue. 


to 


—At 


Now add e~4” y(t) to both sides and multiply by the inverse of e~4’, which is e4' 


by Lemma 1, part 4, to get 
y(t) = Me 4% y (to) +e / e 4" f (u) du. 
to 
Now use Lemma |, part 3, to simplify. We get 
ye) =e Myo t / eM f(a) ds (5) 
to 


This argument shows that if there is a solution, it must take this form. However, it is 
a straightforward calculation to verify that (5) is a solution to (1). We thereby obtain 


Theorem 2 (Existence and Uniqueness Theorem). Let A be ann Xx n constant 
matrix and f (t) an R"-valued continuous function defined on an interval I. Let 
to € I and yy € R". Then the unique solution to the initial value problem 


y(t) =Ay@+ Ff. yt) = yo, (6) 


is the function y(t) defined for t € I by 


Solution to a First Order Differential System 
(7) 
_ t = 

y(t) = eAlt 0) yo ee Si eAlt )f (u) du. 
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Let us break up this general solution into its two important parts. First, when 
f = 0, (6) reduces to y(t) = Ay(t), the associated homogeneous equation. Its 
solution is the homogeneous solution given simply by 


= eAli—wo) 


Yh Yo- 


Let yy = e;, the column vector with | in the ith position and 0’s elsewhere. Define 
y, =e4—e;. Then y; is the ith column of e4¢—), This means that each column 
of e4(—) is a solution to the associated homogeneous equation. Furthermore, if 


an 


then 
— pA(t—to) = ee 
Jn re Yo = UY, + 42Y2. FoF Any), 
is a linear combination of the columns of e“’ and all homogeneous solutions are of 


this form. 
The other piece of the general solution is the particular solution: 


yp(t) = / eA f (u) du. (8) 


We then get the familiar formula 
Y=Ynt Vp: 


The general solution to y’ = Ay + f is thus obtained by adding all possible 
homogeneous solutions to one fixed particular solution. 

When fo = 0, the particular solution y,, of (8) becomes the convolution product 
of e“’ and f (t). We record this important special case as a corollary. 


Corollary 3. Let A be ann xn constant matrix and f (t) an R"-valued continuous 
function defined on an interval I containing the origin. Let yy) € R". The unique 
solution to 


y(t) = Ay) + f@, yO) = yo, 
is the function defined fort € I by 


y(t) =e yo te & f(t). (9) 


When each entry of f is of exponential type, then the convolution theorem, 
Theorem | of Sect. 2.8, can be used to compute yp = e” * f(t). Let us consider a 
few examples. 
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Example 4. Solve the following linear system of differential equations: 


yi =—yit2y2 +e 
—3y, + 4y2 —2e’," (10) 


YS 
with initial conditions y;(0) = 1 and y2(0) = 1. 


> Solution. We begin by writing the given system in matrix form: 
y=Ayt+f, yO=Yo (11) 
where 


-1 2 ce] .f1 _fi 
4=[5 a) f0=La]-¢ La): ot v= [i} 


The characteristic polynomial is 


c4(s) = det(sI — A) = det i ie i = §?~35 +2 = (s—1)(s—2). (12) 


3 s—4 
Therefore, 
| s—4 2 
+ _ | @-D(s-2) (s—1)(s—-2) 
(I-A) = —3 st+1 


(s—I(s—2) (s—D(s—2) 


= 4 3-2], 1 = ae 
es ne ee ee 


It now follows that 
= = 3 +2 =2 2 
At 1 1 t 2t 
=> I-A = . 
e EA Se ; | +e E 4 
By Corollary 3, the homogeneous part of the solution is given by 


Jn = eyo 
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To compute y,, we will use two simple convolution formulas: e’ xe’ = te’ and 
e~ x e! = e* — e!, By Corollary 3, we have 


yp(t) =e" * f(t) 


“6 a)+[5 a))-e[5] 


_ | 7te’ + 6e* — 6e7 
~ | Ttet + 9e! — 9e2! 


Now, adding the homogeneous and particular solutions together leads to the 
solution: 


y(t) = yalt) + yp (t) = ey (0) +e" * f(D) 
ef Tte’ + 6e! — 6e?! 
= t + t t 2t 
e Tte’ + 9e' —9e 
Tte! + Te! — 6e7! 
= : 13 
Ee + 10e’ — | ( a 


Example 5. Find the general solution to the following system of differential 
equations: 

Yi= yot+t 

y= fit 


> Solution. If 


the given system can be expressed as 


YS Ay fi 


By Example 6 of Sect. 9.3, we have e“” = a ‘| If yo = 3 then 
a2 


—sint cost 
‘ et cost sint| | a, e cost a4 sin t 
= = ‘ =a ‘ 2 . 
a —sint cost||a —sint cost 
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Further, 


yp =e « fi) = cost mn 7 BH = (cost) * t — (sint) wr 


—sint cost t —(sint) * t — (cost) *t 


Table 2.11 gives formulas for the convolutions (cos ft) * ¢ and (sint) * t. However, 
we will use the convolution principle to make these computations. First, 


Ss 1 1 ai RY 
(s?+1)s2 (S24 1s 8 s?41’ 
1 1 1 


and L{(sint)*t}= Gas — 2° 2a 


L{(cost) *t} = 


so that (cost) * f = 1 — cost and (sint) * t = t — sint. Therefore, 


_ 1 —cost — (t —sint) 
Vp = —(t —sint) — (1 —cost) |" 


By Corollary 3, the general solution is thus 


cost sin t 1—t-—cost +sint 
yOH=a ; + a2 i : F 
—sint cost —l—t+sint+ cost 


which we can rewrite more succinctly as 


cost sin t 1-t 
y= @-D| 7 ]r@+o] |+| 
—sint cost —l-t 
cost sin t 1-t 
= ay ; + Oy + 
—sint cost —l-t 
after relabeling the coefficients. < 


Example 6. Solve the following system of equations: 


2yi + yo + 1/t yi) = 2 
—4y;-2y24+2/t = y(l)=1 


II 


yi 
V5 


II 


on the interval (0, 00). 


> Solution. We can write the given system as y’ = Ay + f, where 


=| & 4 _ fist 2 
[2 of = v0-ff 
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Observe that f is continuous on (0, 00). The characteristic polynomial is 


ca(s) = det ° - : =s’ (14) 


and B., = {1,t}. Therefore, e“’ = M; + Mot and its derivative is Ae“’ = Mb. 
Evaluating at t = 0 gives M, = J and M) = A. Fulmer’s method now gives 


4 1+ 2t t 
e’=]+4+At= : 
—4t 1-2t 


It follows that 


ph AS ay [LOE S=D (11) _ 7 243¢=0) 
yal) =e vi =| —4(t — 1) oe eel ae 


The following calculation gives the particular solution: 


yp(t) / eM f (u) du 


t 
| e 4" f (u) du 
1 


t 
of 1—2u —u||1/u ty 
1 4u 14+ 2u||2/u 


II 


ll 
% 
-—— 
SIN sje 
+ | 
oo oO 
cca 


II 


1+ 2t t Int —4(¢ — 1) 
—4t 1-—2t||2Int+ 8-1) 
_ \ + 4t) Int —4t | 


~ | (2—84)Int + 8t—8 


A(t—u) eA 


Where in line 2 we used Lemma | to write e ‘e— 4" We now get 


(1) = Wn) + YO) 


_ | 2+5(¢-1) (1+ 4t) Int -—4¢t+4 
~~ = h0G =1) (2—8r) Int + 8t—8 


_f{ 1l+¢1+(4+ 46) Int 
~ |3—2t¢ + (2-88) Int }’ 


valid for all tf > 0. | 
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Example 7. Solve the mixing problem introduced at the beginning of this chapter 
in Example | of Sect. 9.1. Namely, 


=4 1 
i(t) = —yi(t) + —yr(t) + 3 
yi) 10 21 Nes 1922) + 


4 4 
WO = Gl) — FW. 


with initial condition y;(0) = 2 and y2(0) = 0. Also, determine the amount of salt 
in each tank at time ¢ = 10. 


> Solution. In matrix form, this system can be written as 


y(t) = Ay@) + f@), 


where 
—4/10 1/10 3 2 
A= > FO=] J}, and yo= yO=] |. 
4/10 —4/10 0 0 
We let the reader verify that 
eft — 97 2r/10 1/2 1/4 4 e76t/10 1/2 1/4 
1 1/2 -1 1/2 
The homogeneous solution is 
y,(t) = eMy, — { e-2#/10 1/2 1/4 + en 6/10 1/2 —1/4 2 
1 1/2 =1 1/2 0 
1 1 
— e-2t/10 —6t/10 
e B +e Ez} | 


We use the fact that e~24/0 x 1 = 5 — 5e77#/19 and e— 6/10 & 1 = 3 (5 — Se #/19) 
to get 


Y= eM B = 3e"! x A 


veel peers 0 
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= 3(5— Se!) be + (5 — 5e76/10) hal 


—1 
_ | 10 — eo 2t/10 15/2 964/10 5/2 
10 15 a6" 


We now obtain the solution: 


yt) = 9,0) + y,@) 


— | 10], aro | -13/2] oro | —3/2 
= [io] +2 _13 +e 3|° 


At time t = 10, we have 


y(10) = ha (13/2)e~* — | 7 Be | 


10 — 13e~? + 3e~ 8.248 


Att = 10 minutes, Tank | contains 9.117 pounds of salt and Tank 2 contains 8.248 
pounds of salt. < 


We now summarize in the following algorithm the procedure for computing the 
solution to a constant coefficient first order system. 


Algorithm 8. Given a constant coefficient first order system, 


y =Ayt+f, yt) =Yo 


we proceed as follows to determine the solution set. 


Solution Method for a Constant Coefficient 
First Order System 


1. Determine e“’: This may be done by the inverse Laplace transform formula 
eM! = £7! {(sI — A)~!} or by Fulmer’s method. 

2. Determine the homogeneous part y,(t) = e4¢—” y (to). 

3. Determine the particular solution y,(t) = i e4U— f (u) du. It is some- 
times useful to use e4¢— = ee“ 4", 


4. The general solution is y, = y, + Yp- 
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Eigenvectors and Eigenvalues 


When the initial condition yy = v is an eigenvector for A, then the solution to 
y’ = Ay, y(0) = y, takes on a very simple form. 


Lemma 9. Suppose A is ann Xn matrix and v is an eigenvector with eigenvalue 
4. Then the solution to 


y’=Ay, yO)=v 


In other words, 


Ar 


ety = e*y, 


Proof. Let y(t) = ev. Then y/(t) = Ae*v and Ay(t) = e* Av = Ae*'v. 
Therefore, y’(t) = Ay(t). By the uniqueness and existence theorem, we have 


Example 10. Let A = ; Ar Find the solution to 


yYO=4yO, yO)= B 


> Solution. We observe that B is an eigenvector of A with eigenvalue 5: 


Thus, 
1 
ite 
y(t) =e B 
: : : ; 1 
is the unique solution to y’ = Ay, y(0) = >|: « 
More generally, we have 
Theorem 11. Suppose v = civ, +--+ + cgvp, where v\, ..., Ve are eigenvectors of 
A with corresponding eigenvalues i,,...,A,%. Then the solution to 


y'=Ay, yO)=v 
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y =cye yy fee + cg yg, 


Proof. By Theorem 2, the solution is y(t) = e“‘v. By linearity and Lemma 9, we get 


y(t) = ey = cyeyy +e + cg; 


= ce yy Hee + cee yp. Oo 


Existence and Uniqueness Theorems 


We conclude this section with the existence and uniqueness theorems referred to 
earlier in the text, namely, Theorem 10 of Sect. 3.1 and Theorem 5 of Sect. 4.1. 

For convenience of expression, we will say that an R”-valued function f is an 
exponential polynomial if each component f; of f is an exponential polynomial. 
Similarly, we say that an R”-valued function f is of exponential type if each 
component f; of f is of exponential type. 


Corollary 12. Suppose f is an exponential polynomial. Then the solution to 


y(t) =Ay(t)+ f(t), y(t) = Yo 


is an exponential polynomial defined on R. 


Proof. The formula for the solution is given by (7) in Theorem 2. Each entry in 
e“’ is an exponential polynomial. Therefore, each entry of e4¢~) = e4’e~4% is 
a linear combination of entries of e“’, hence an exponential polynomial. It follows 
that e4¢—) y) is an exponential polynomial. The function u > e4~" f (u) is a 
translation and product of exponential polynomials. Thus, by Exercises 34 and 35 
of Sect. 2.7 it is in €, and by Exercise 37 of Sect. 2.7 we have Si e4—) f (u) du is 
in €. Thus, each piece in (7) is an exponential polynomial so the solution y(t) is an 


exponential polynomial. oO 


Corollary 13. Suppose f is of exponential type. Then the solution to 


y(t) = Ay(t)+ f(t), y(to) = yo 


is of exponential type. 


Proof. By Proposition | of Sect. 2.2, Exercise 37 of Sect. 2.2, and Lemma 4 of Sect. 
2.2, we find that sums, products, and integrals of functions that are of exponential 
type are again of exponential type. Reasoning as above, we obtain the result. oO 


Theorem 14 (The Existence and Uniqueness Theorem for Constant Coefficient 
Linear Differential Equations). Suppose f(t) is a continuous real-valued func- 
tion on an interval I. Let ty) € I. Then there is a unique real-valued function y 
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defined on I satisfying 
(n) MDa. gy! = f(t 15 
Any + any" ++ ay +aoy = f(t), (15) 
with initial conditions y(to) = yo, y'(to) = yi, ...¥"~) = yn—1. If f(t) is of 


exponential type, so is the solution y(t) and its derivatives y(t), fori = 1, .. 
n —1. Furthermore, if f(t) is in E, then y(t) is also in E. 


” 


Proof. We may assume a, = | by dividing by a,, if necessary. Let yj = y, y2 = 
ee ye) and let y be the column vector with entries y1, ..., y,. Then 
Vp = IW = Yr, ees Myay = VOY = Yn, and 


y, = y® = —ayy — ary’ —ary” ee a a re f 


—ao V1 — 41 y2 — A2Y3 — +++ — An—-1Yn + f. 


It is simple to check that y is a solution to (15) if and only if y is a solution to (1), 
where 


0 1 O tee 0 0 yo 

0 1 0 0 v1 

A=| : }. f=] if. and y=]: 
0 0 0 1 0 Vn—2 

—a9  —@y ts —Gn-2 —En-1 7 Yn-1 


By Theorem 2, there is a unique solution y. The first entry, y, in y is the unique 
solution to (15). If f is an exponential polynomial, then f is likewise, and 
Corollary 12 implies that y is an exponential polynomial. Hence, yj = y, yo = y’, 
wees Yn = y") are all exponential polynomials. If f is of exponential type, then 
so is f, and Corollary 13 implies y is of exponential type. This, in turn, implies y, 
y’,..., y"! are each of exponential type. Oo 
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Exercises 


1-9. Solve the homogeneous systems y’ = Ay, y(0) = Yo, for the given A 
and yo. 


| ae 

FS) oe 1 
6 a=[7 3h x@=(_|] 

as rr El 
7 a=[' ak vo =|] 


10-17. Use Corollary 3 to solve y’ = Ay + f for the given matrix A, forcing 
function f, and initial condition y (0). 


2 -1 e’ 1 
Ero [bof 
-1 2 5 1 
3) a} ro=[f}eo=|)) 

2. -=9 2cost 1 
1 || fO= el yO= |_| 


| 
| 
3.4=[> i} r0=[T]20=|_4] 
| 
| 


— 
j=) 


11. A= 


12, A= 


21 e 1 
14. A=]) 70 = Bao = H 


5 2 t 0 
15. A=| 9 | fO= loi | xo = H 
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=F. 9 of e 7! 2 
16.A=|] 0 -1 O,f@= 0|},y@)=] 1 

2 2 -1 —e 

01 1 e7! 0 
WA=|] 1 7 =1),fO=) & 1,90) =] 0 

=2 1 3 —e”! 0 


18-21. Solve each mixing problem. 


18. Two tanks are interconnected as illustrated below. 


Tank 1 Tank 2 


Assume that Tank | contains 1 gallon of brine in which 4 pounds of salt 
are initially dissolved and Tank 2 initially contains 1 gallon of pure water. 
Moreover, at time ¢ = 0, the mixtures are pumped between the two tanks, 
each at a rate of 2 gal/min. Assume the mixtures are well stirred. Let y(t) be 
the amount of salt in Tank | at time ¢ and let y(t) be the amount of salt in 
Tank 2 at time t. Determine y,, y. Find the amount of salt in each tank after 30 
seconds. 
19. Two tanks are interconnected as illustrated below. 


gal 
min 


Tank 1 Tank 2 


Assume that Tank | contains | gallon of brine in which 4 pounds of salt is 
initially dissolved and Tank 2 contains 2 gallons of pure water. Moreover, the 
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mixture from Tank | is pumped into Tank 2 at a rate of 2 gal/min. Assume that 
a brine mixture containing | lb salt/gal enters Tank | at a rate of 2 gal/min and 
the well-stirred mixtures in both tanks are removed from Tank 2 at the same 
rate. Let y(t) be the amount of salt in Tank | at time ¢ and let y(t) be the 
amount of salt in Tank 2 at time ¢. Determine y; and yy. Determine when the 
concentration of salt in Tank 2 is 1/2 Ibs/gal. 

20. Two tanks are interconnected as illustrated below. 


gal gal 
min min 


2 


Assume that Tank 1 contains | gallon of pure water and Tank 2 contains | gallon 
of brine in which 4 pounds of salt is initially dissolved. Moreover, the mixture 
from Tank | is pumped into Tank 2 at a rate of 1 gal/min. Assume that a brine 
mixture containing 4 Ib salt/gal enters Tank | at a rate of 2 gal/min and pure 
water enters Tank 2 at a rate of 1 gal/min. Assume the tanks are well stirred. 
Brine is removed from Tank | at the rate 1 gal/min and from Tank 2 at a rate of 
2 gal/min. Let y,(t) be the amount of salt in Tank 1 at time ¢ and let yo(t) be 
the amount of salt in Tank 2 at time ¢. Determine y; and y2. Determine when 
the amount of salt in Tank 2 is at a minimum. What is the minimum? 
21. Two tanks are interconnected as illustrated below. 


ol gal 
min min 


= 


Tank 1 Tank 2 
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Assume initially that Tank 1 and Tank 2 each contains 1 gallon of pure water. 
Moreover, the mixture from Tank | is pumped into Tank 2 at a rate of 5 gal/min 
and the mixture from Tank 2 is pumped into Tank | at a rate of 3 gal/min. 
Assume that a brine mixture containing | lb salt/gal enters both tanks at a rate 
of 2 gal/min. Assume the tanks are well stirred. Brine is removed from Tank 2 
at the rate 4 gal/min. Let y;(¢) be the amount of salt in Tank 1 at time ¢ and let 
y2(t) be the amount of salt in Tank 2 at time ¢. Determine y, and yo. 
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9.6 The Phase Plane 


This section addresses some of the qualitative features of homogeneous solutions 
to constant coefficient systems of differential equations. We restrict our attention to 
the case n = 2 and write the dependent variables in the form 


_ | x(t) 
70 = [i 


Thus, if z(0) = Zo, then the initial value problem that we consider is 
z(t) = Az(t), (0) = Zo, (1) 


where A is a 2 x 2 matrix. We will think of each z(t) as a point (x(t), y(¢)) in the 
Euclidean plane, usually referred to as the phase plane in this context.° The set of 
points {(x(¢t), y(t)) : ¢ € R} traces out a path or orbit, and to each path, we can 
associate a direction: the one determined by ¢ increasing. Such directed paths are 
called trajectories. The phase portrait shows trajectories for various initial values 
in the phase plane. The shape of the paths, the direction of the trajectories, and 
equilibrium solutions are some of the qualitative features in which we are interested. 
As we will see, the eigenvalues of A play a decisive role in determining many of 
important characteristics of the phase portrait. 


Affine Equivalence 


Our study of the phase portrait for z’ = Az can be simplified by considering an 
affine equivalent system w’ = Bw, where B is a 2 x 2 matrix that has a particularly 
simple form. Let P be a 2 x 2 invertible matrix. The change in variables 


z= Pw (2) 


is called an affine transformation. *More specifically, if 
pale aa z= |"), anaw =|", 
P21 P22 y Vv 


3See the article “The Tangled Tale of Phase Space” by David D. Nolte (published in Physics Today, 
April 2010) for an account of the history of ‘phase space’. 


4More generally, an affine transformation is a transformation of the form z = Pw + wo, where 
P is an invertible matrix and wo is a fixed translation vector. For our purposes, it will suffice to 
assume Wo = 0. 
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then the equation z = Pw becomes 


X = put Pv, 
y = prut pv. 


Since P is invertible, we also have w = P—'z. Thus, we are able to go from one set 
of variables to the other. Since P is a constant matrix, we have the following 


w! = P7!7' = P-!Az = P| APw. (3) 
If we set B = P~'AP, then (3) becomes 
w’ = Bw (4) 


and the associated initial condition becomes wo) = w(0) = P !zo. Once w is 
determined, we are able to recover z by the equation z = Pw, and vice versa, once 
z is determined, we are able to recover w by the equation w = P~'z. The idea is 
to find an affine transformation P in such a way that B = P~' AP is particularly 
simple, for example, diagonal, something “close to diagonal”, or something that 
is distinctively simple” (see “Jordan Canonical Forms” below for a description of 
exactly what we mean). Two matrices A and B are called similar if there is an 
invertible matrix P such that B = P~!AP. 

Affine transformations are important for us because certain shapes in the (u, v) 
phase plane are preserved in the (x, y) phase plane. Specifically, if z = Pw is an 
affine transformation, then 


1. A line in the (u, v) phase plane is transformed to a line in the (x, y) phase plane. 
If the line in the (u, v) plane goes through the origin, then so does the transformed 
line. 

2. An ellipse in the (u, v) phase plane is transformed to an ellipse in the (x, y) phase 
plane. (In particular, a circle is transformed to an ellipse.) 

3. A spiral in the (u,v) phase plane is transformed to a spiral in the (x, y) phase 
plane. 

4. A power curve® in the (u,v) phase plane is transformed to a power curve in the 
(x, y) phase plane, for example, parabolas and hyperbolas. 

5. A tangent line L to a curve C in the (u,v) phase plane is transformed to the 
tangent line P(L) to the curve P(C) in the (x, y) phase plane. 


>Many texts take this approach to solve constant coefficient systems. Our development of the 
Laplace transform allows us to get at the solution rather immediately. However, to understand 
some of the qualitative features, we make use of the notion of affine equivalence. 


By a power curve we mean the graph of a relation Ax + By = (Cx + Dy)?, where p is a real 
number and all constants and variables are suitably restricted so the power is well defined. 
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6. A curve C that lies in a region R in the (u, v) phase plane is transformed to a 
curve P(C) that lies in the region P(R) in the (x, y) phase plane. 


You will be guided through a proof of these statements in the exercises. In view 
of the discussion above, we say that the phase portraits of z’ = Az andz’ = Bz are 
affine equivalent if A and B are similar. 

To illustrate the value of affine equivalence, consider the following example. 


Example 1. Discuss the phase portrait for the linear differential system 


z(t) = Ag(t), 


“EY 


> Solution. The characteristic polynomial of A is c4(s) = s? —9s +18 = (s —3) 


(s — 6). The eigenvalues of A are thus 3 and 6. By Fulmer’s method, we have e“’ = 


Me™ + Ne“ from which we get 


where 


I=M+N 
A=3M+O6N. 


From these equations, it follows that 


1 1{ 2 -1 


Hence, 


A short calculation gives the solution to z’(t) = Az(t) with initial value z(0) = 
as 
C2 
1 3t 1 6t 
x(t) = 3 2e1 —co)e" + 31 + co)e 


1 2 
yt)= = ei —cr)e* + 7G + cre (5) 
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The orbits {(x(t), y(¢)) : ¢ € R} are difficult to describe in general except for a 
few carefully chosen initial values. Notice that 


1. If c) = 0 and cy = O, then x(t) = y(t) = O so that the origin (0,0) is a 
trajectory. 

2. If cy = —c, # 0, then x(t) = cye* and y(t) = —cy,e*. This means that the 
trajectory is of the form 


(x(t), y(t)) = (cre, —cye*”) = cye* (1, —1). 


The function e* is positive and increasing as a function of ¢. Thus, if c; is 
positive, then the trajectory is a half-line in the fourth quadrant consisting of all 
positive multiples of the vector (1,—1) and pointing away from the origin. This 
is the trajectory marked A in Fig. 9.1 in the (x, y) phase plane. If c; is negative, 
then the trajectory is a half-line in the second quadrant consisting of all positive 
multiples of the vector (—1, 1) and pointing away from the origin. 

3. If co = 2c, # 0, then x(t) = cye™ and y(t) = 2c\e%. This means that the 
trajectory is of the form 


(x(t), y(t) = (cre™, 2cye™) = cye™ (1, 2). 


Again e“ is positive and increasing as a function of f. Thus, if c; is positive, the 
trajectory is a half-line in the first quadrant consisting of all positive multiples of 
the vector (1, 2) and pointing away from the origin. This is the trajectory marked 
D in Fig. 9.1 in the (x, y) phase plane. If c, is negative, then the trajectory is 
a half-line in the third quadrant consisting of all positive multiples of the vector 
(—1, —2) and pointing away from the origin. 


For initial values other than the ones listed above, it is rather tedious to directly 
describe the trajectories. Notice though how a change in coordinates simplifies 
matters significantly. In (5), we can eliminate e®™ by subtracting y(t) from twice 
x(t) and we can eliminate e*” by adding x(t) and y(t). We then get 


2x(t) — y(t) = (2c; — cn) e* = kye*, 
x(t) + y(t) = (cr + er)e™ = koe, (6) 


where k; = 2c, — cp and ky = c, + co. Now let 
u=2x—y _|2 —l}|x 
v= xty [1 Ily] 


The matrix ; “| is invertible and we can thus solve for *| to get 
y 
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D C D 
B Cc 
B 
A 
A 
(u,v) phase plane (x,y) phase plane 
uo = 3u a = 4n + y 
v' = 6v y! = Qe 4+ 5y 
Fig. 9.1 Affine equivalent phase portraits 
a) fy) 2.4 
yy! Silt Bly 
1 1 7 : : 
Let P = 3/1 21° This is the affine transformation that implements the change 


in variables that we need. A simple calculation gives 


= peta Le = If 1:1) e 
aia ap= sli ‘ALE ll l=[3 ‘|: 7) 


a diagonal matrix consisting of the eigenvalues 3 and 6. 

We make an important observation about P here: Since A has two distinct 
eigenvalues, there are two linearly independent eigenvectors. Notice that the first 
column of P is an eigenvector with eigenvalue 3 and the second column is an 
eigenvector with eigenvalue 6. The importance of this will be made clear when we 
talk about Jordan canonical forms below. 


Ifw= | then 
v 


and the initial condition is given by 


aa 2 =) fer) [2e=e2] _ a 
w(0) =P 20) =| Wleleleeel tel 
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The equations for w’ = Bw are simply 


The solutions can be computed directly and are 
u(t) = kye* and v(t) = kye™, 


which are also consistent with (6). In these variables, it is a simple matter to compute 
the phase portrait. Let us first take care of some special cases. Notice that 


1. If k} = O and ky = O, then u(t) = v(t) = O so that the origin (0,0) is a 
trajectory. 
2. Ifk; #0 and kz = 0, then the trajectory is of the form 


(u(t), v(t)) = kie™ (1, 0). 


As before, we observe that e* is positive and increasing. Thus, if k1 is positive, 
the trajectory is the positive u-axis pointing away from the origin. This is the 
trajectory marked A in Fig.9.1 in the (uw, v) phase plane. If k; is negative, then 
the trajectory is the negative u-axis pointing away from the origin. 

3. Ifk; = 0 and kz ¥ 0 then the trajectory is of the form 


(u(t), v(t)) = koe (0, 1). 


Again e“ is positive and increasing. Thus if k» is positive, then the trajectory is 
the positive y-axis pointing away from the origin. This is the trajectory marked 
D in Fig. 9.1 in the (u, v) phase plane. If k2 is negative, then the trajectory is the 
negative y-axis pointing away from the origin. 


Now assume k, # 0 and ky # 0. Since e* and e®™ take on all positive real 
numbers and are increasing, the trajectories (u(t), v(t)) = (kye*", k2e™) are located 
in the quadrant determined by the initial value (k,,k2) and are pointed in the 
direction away from the origin. To see what kinds of curves arise, let us determine 
how u(t) and v(t) are related. For notation’s sake, we drop the “t” in u(t) and v(t). 
Observe that kyu? = kikoe™ = ky, and hence, 


Hence, a trajectory is that portion of a parabola that lies in the quadrant determined 
by the initial value (k;,k2). In Fig.9.1, the two trajectories marked B and C are 
those trajectories that go through (4, 3) and (1, 1), respectively. The other unmarked 
trajectories are obtained from initial values, (+1, +1) and (+4, +3). 
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Now to determine the trajectories in the (x, y) phase plane for z’ = Az, we utilize 
the affine transformation P. Since 


u u| 1 vi}1 
ele sLal+slal 
it follows that the region determined by the first quadrant in the (u, v) phase plane 
transforms to the region consisting of all sums of nonnegative multiples of (1, —1) 
and nonnegative multiples of (1,2). We have shaded those regions in Fig.9.1. An 
affine transformation such as P transforms parabolas to parabolas and preserves 
tangent lines. The parabola marked B in the (u,v) plane lies in the first quadrant 
and is tangent to the trajectory marked A at the origin. Therefore, the transformed 
trajectory in the (x, y) phase plane must (1) lie in the shaded region, (2) be a 
parabola, and (3) be tangent to trajectory A at the origin. It is similarly marked 
B. Now consider the region between trajectory B and D in the (u, v) phase plane. 
Trajectory C lies in this region and must therefore transform to a trajectory which 
(1) lies in the region between trajectory B and D in the (x, y) phase plane, (2) 
is a parabola, and (3) is tangent to trajectory A at the origin. We have marked it 
correspondingly C. The analysis of the other trajectories in the (u, v) phase plane is 
similar; they are each transformed to parabolically shaped trajectories in the (x, y) 
phase plane. < 


Jordon Canonical Forms 


In the example above, we showed by (7) that A is similar to a diagonal matrix. In 
general, this cannot always be done. However, in the theorem below, we show that 
A is similar to one of four forms, called the Jordan Canonical Forms. 


Theorem 2. Let A be a real 2 x 2 matrix. Then there is an invertible matrix P so 
that P~' AP is one of the following matrices: 


A, O|] Ay,A.ER 41 0 
Lie } = ER 
a Ee uf er us ki | =e 
_ {a 0 _fa -£ 
2. a=|i peer 4. n=|5 peer B>o. 


Furthermore, the affine transformation P may be determined correspondingly as 
follows: 


1. If A has two distinct real eigenvalues, A, and Xo, then the first column of P is an 
eigenvector for 4, and the second column of P is an eigenvector for A>. 
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2. If A has only one real eigenvalue i with eigenspace of dimension |, then the first 
column of P may be chosen to be any vector v that is not an eigenvector and the 
second column of P is (A—Al)v. 

3. If A has only one real eigenvalue with eigenspace of dimension 2 then A is J. 
Hence, P may be chosen to be the identity. 

4. If A has a complex eigenvalue, then one of them is of the form a —iB with B > 0. 
If w is a corresponding eigenvector, then the first column of P is the real part of 
w and the second column of P, is the imaginary part of w. 


Remark 3. Any one of the four matrices, Ji,..., J4 is called a Jordan matrix. 
Note that the affine transformation P is not unique. 


Proof. We consider the eigenvalues of A. There are four possibilities. 


1. Suppose A has two distinct real eigenvalues 4, and A2. Let v; be an eigenvector 
with eigenvalue A; and v2 an eigenvector with eigenvalue A. Let P = [vy vo], 
the matrix 2 x 2 matrix with v; the first column and v2 the second column. Then 


A (OO 


AP = [Avy Avo | = [Ain Anv?| = [v1 val f Oy 33 


|= Pe 


Now multiply both sides on the left by P~! to get P~-'AP = J. 

2. Suppose A has only a single real eigenvalue 4. Then the characteristic polyno- 
mial is c4(s) = (s—A)?. Let Ey be the eigenspace for A and suppose further that 
E, # R?. Let v, be a vector outside of E,. Then (A — AJ)v,; 4 0. However, by 
the Cayley-Hamilton theorem (see Appendix A.5), (A —AI)(A—Al)vy, = (A- 
AI)?v, = 0. It follows that (A — AJ)v, is an eigenvector. Let v. = (A — AI). 
Then Av) = ((A—AI) + AD)y, = v2 + Ay and Av2 = Av2. Let P = [vi v2 | 
be the matrix with v; in the first column and v2 in the second column. Then 


A 0 


AP = [Avy Avo | = [v2 + Ay) Ava] = [vy v2 | E a 


= Phy, 
Now multiply both sides on the left by P~! to get P~!'AP = Jo. 

3. Suppose A has only a single real eigenvalue A and the eigenspace E, = R?’. 
Then Av = Av for all v € R*. This means A must already be J3 = A. 

4. Suppose A does not have a real eigenvalue. Since A is real, the two complex 
eigenvalues are of the forma+if anda—if, with 6 > 0. Let w be an eigenvector 
in the complex plane C? with eigenvalue w — if. Let v; be the real part of w and 
v2 the imaginary part of w. Then w = v; + iv and since 


A(v1 +iv2) = (a — iB) +iv2) = (avi + Bv2) + i(—Bvi + av2) 
we get 


Avy, = av, + Bro, 
Av2 = —Bv, + AV2. 
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Let P = [vi v2]. Then 


AP = [Avi Avo] = [ov + By. —By + avy] = [vi vo | F Bi = PJ x. 


Now multiply both sides on the left by P~! to get P~!'AP = Jy. o 


Example 4. For each of the following matrices, determine an affine transformation 
P so the P~! AP is a Jordan matrix: 


6 -2 -5 2 —5 -8 
1. A= Ae .A= 


> Solution. 1. The characteristic polynomial is c4(s) = (s — 6)(s —7)-6 = 
s? — 13s + 36 = (s — 4)(s — 9). There are two distinct eigenvalues, 4 and 9. It is 


: 1]. : ee vi 
an easy calculation to see that vj = H is an eigenvector with eigenvalue 4 and 


v2 = 3] is an eigenvector with eigenvalue 9. Let 


Then an easy calculation gives 


PAP = ioe 
0 9{" 


2. The characteristic polynomial is c4(s) = (s + 3)”. Thus, A = —3 is the only 


eigenvalue. Since A——3] = - | , it is easy to see that all eigenvectors are 


multiples of A Let vy) = ik Then vj is not an eigenvector. Let 


vca-w= [3 IL]-E] 


Let 


690 9 Linear Systems of Differential Equations 


Then an easy calculation gives 


cee 
“AP = . 


. The characteristic polynomial is c4(s) = s? + 2s + 17 = (s + 1)? + 16 80 the 
eigenvalues are —1 + 47. We compute an eigenvector with eigenvalue —1 — 47. 


To do this, we solve 
a 0 
—-1-—4i)I-A = 
«1-41- 4/2] =[)) 


for a and b. This is equivalent to 


(4—4i)a + 8b =0, 
—4a + (-4—4i)b = 0. 


—8  —- -8(44.4i) 
4-4) (4-4i)(44+4i) 


“Crete 


is an eigenvector for A with eigenvalue —1 — 47. Let vy; = | and vz = Pal 


—1-i. Therefore, 


If we choose b = 1, thena = 


be the real and imaginary parts of v. Let 


Then 


poiyp=,| 
7 al 


Notice in the following example the direct use of affine equivalence. 


Example 5. Discuss the phase portrait for the linear differential system 


z(t) = Az(t), 


where 
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> Solution. The characteristic polynomial is 

ca(s) = s* +25+17=(s+1)* +16. 
It is straightforward to determine that 

eAt = ent | 008 4t —sin4t 2 sin 4t 
> sin4t cos4t+sin4r|° 
For a given initial condition z(0) = a , we have 
c2 
x(t) = e*(c; cos 4t + (2c. — c;) sin 4t) 
y(t) =e" ((c) + cr) sin 4t +c. cos 414). 


The phase plane portrait for this system is very difficult to directly deduce without 
the help of an affine transformation. In Example 4, part 3, we determined 


oA 


and 
—1 —-4 
B=P'AP= ; 
Al 
In the new variables z = Pw, we get w’ = Bw, and the initial condition is 
given by 


(0) = P~!z(0) = | 4 Bl = Ba | . 


Let 4 = oe | A straightforward calculation gives 
=Cy — C2 


cos4t —sin4t 
eB _ e! - 
sin 4t cos 4t 


and 


uw] _ gar [ki] _ y+ [ ki cos4e — ko sin 4 
Vv ky k, sin4t + ko cos 4t | 
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(u,v) phase plane (x,y) phase plane 
ul’ = —u—4v a’ = —5a — 8y 
v = 4u-—v yo = 4a + 3y 


Fig. 9.2 Spiral phase portraits 
If ¢ is the angle made by the vector (k,, kz) and the positive u-axis, then 


ky ko 
(e+ vei tk 


We can then express u and v as 


u(t) = Vk? + k5e ‘(cos cos 4t — sing sin4t) = \/k7 + kye ‘(cos(4t + $)), 
v(t) = ki + ke‘ (cos ¢ sin 4t + sing cos 4t) = \/k? + kje‘(sin(4t + ¢)), 


Now observe that 


cos¢ = and sing = 


w(t) + v(t) = (ki +k)e*. 


If u2(t) + v?(t) were constant, then the trajectories would be circles. However, the 
presence of the factor e~’ shrinks the distance to the origin as f increases. The 
result is that the trajectory is a spiral pointing toward the origin. We show two such 
trajectories in Fig. 9.2 in the (u, v) phase plane. 

Notice that the trajectories in the (u, v) phase plane rotate one onto another. By 
this we mean if we rotate a fixed trajectory, you will get another trajectory. In fact, 
all trajectories can be obtained by rotating a fixed one. Specifically, if we rotate a 
trajectory by an angle @. Then the matrix that implements that rotation is given by 


sin 0 cos 0 


R(6) = io or 
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It is a nice property about rotation matrices that they commute. In other words, if 0; 
and 6» are two angles, then 


R(O,) R(@2) = R(O2) RO). 
Now observe that e?’ = e~’ R(41). When we apply R(@) to w, we get 
R(O)w(t) =e ' R(O)R(4t)k = e' R(4t) (R(O)k) = 8’ (R(O)k). (8) 


Thus, R(@)w(t) is the solution to w’ = Bw with just a different initial condition, 
namely, R(@)k. 

Now to see what is going on in (x, y) phase plane, we use the affine map P. 
In the (u,v) phase plane, we have drawn a gray circle centered at the origin (it is 
not a trajectory). Suppose its radius is k. Recall that an affine transformation maps 
circles to ellipses. Specifically, since w = P~!z, we have u = y andv = —x —y. 
From this we get 


Raw tv = y+ x27 4+ 2xy t+ yp? = x7 4 2xy + 2y’. 


This equation defines an ellipse. That ellipse is drawn in gray in the (x, y) phase 
plane. The trajectories in the (x, y) phase plane are still spirals that point toward the 
origin but elongate in the direction of the semimajor axis of the ellipse. < 


Critical Points 


A solution for which the associated path 


{Q@), y()).t € RS 


is just a point is called an equilibrium solution or critical point. This means then 
that x(t) = c; and y(t) = cp for all ¢ € R and occurs if and only if 


C2 


ee | (9) 


If A is nonsingular, that is, det A 4 0, then (9) implies c = 0. In the phase portrait, 
the origin is an orbit and it is the only orbit consisting of a single point. On the other 
hand, if A is singular, then the solutions to (9) consists of the whole plane in the 
case A = 0 and a line through the origin in the case A # 0. If A = 0, then the 
phase portrait is trivial; each point in the plane is an orbit. If A 4 0 (but singular), 
then each point on the line is an orbit and off that line there will be nontrivial orbits. 
We will assume A is nonsingular for the remainder of this section and develop the 
case where A is nonzero but singular in the exercises. 
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0<Ay <A>, Ay <O0< AQ Ay < Ay <0 
unstable node saddle stable node 


Fig. 9.3. Phase portrait for the canonical system J; 


The Canonical Phase Portraits 


In view of Theorem 2, all phase portraits are affine equivalent to just a few simple 
types. These types are referred to as the canonical phase portraits. There are 
four of them (if we do not take into account directions associated with the paths) 
corresponding to each of the four Jordan canonical forms. Let us consider each 
case. 


Ji: In J,, we will order the eigenvalues A; and A» to satisfy 4, < A». Since 
det A # 0, neither A, nor Az are zero. The solutions to z’ = J\z are x(t) = cye*" 
and y(t) = cze*2". Therefore, the trajectories lie on the power curve defined by 


42 
|y(t)| = K |x(t)|* (a similar calculation was done in Example 1). The shape of 
the trajectories are determined by p = A2/A,. Refer to Fig. 9.3 for the phase portrait 
for each of the following three subcases: 


1. Suppose 0 < A, < Az. Then x(t) and y(t) become infinite as ¢ gets large. The 
trajectories lie on the curve |y| = K |x|’, p > 1. All of the trajectories point 
away from the origin; the origin is said to be an unstable node. 

2. Suppose A; < 0 < Az. Then x(t) approaches zero while y(t) becomes infinite as 
t gets large. The trajectories lie on the curve |y| = K/ |x|’, where g = —p > 0. 
The origin is said to be a saddle. 

3. Suppose A; < Az < 0. Then x(t) and y(t) approach zero as ¢ gets large. The 
trajectories lie on the curve |y| = K|x|?,0 < p < 1. In this case, all the 
trajectories point toward the origin; the origin is said to be a stable node. 


Jz : It is straightforward to see that the solutions to z’ = Jyz are x(t) = ce" and 
y(t) = (cyt + c2)e*". Observe that if c; = 0, then x(t) = 0 and y(t) = coe”. 
If cz > 0, then the positive y-axis is a trajectory, and if cz < 0, then the negative 
y-axis is a trajectory. Now assume c; 4 0. We can solve for y in terms of x as 
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Fig. 9.4 Phase portrait for 
the canonical system J2 


A<0 A>0 
stable improper node unstable improper node 


follows. In the equation, x(t) = cje“", we get t = + In (2). Substituting into y(t) 


x x Cox 
y= vin(=) 4% (10) 
Xr Cy 

Note that if c; > 0, then x > O and the trajectory lies in the right half plane, and 
if c; < 0, then x < 0 and the trajectory lies in the left half plane. An easy exercise 
shows that the graph of Equation (10) has a vertical tangent at the origin; the origin 
is called an improper node. Now refer to Fig. 9.4 for the phase portrait for each of 
the following two subcases: 


gives 


1. Suppose A < 0. Then x(t) and y(t) approach zero as ¢ gets large. Thus, all 
trajectories point toward the origin. In this case, the origin is stable. If c; < 0, 
then the trajectory is concave upward and has a single local minimum. If c; > 0, 
then the trajectory is concave downward and has a single local maximum. 

2. Suppose A > 0. Then x(t) and y(t) approach infinity as ¢ gets large. Thus, 
all trajectories point away from the origin. In this case, the origin is unstable. If 
c, < 0, then the trajectory is concave downward and has a single local maximum. 
If c; > 0, then the trajectory is concave upward and has a single local minimum. 


J3 : It is straightforward to see that the solutions to z’ = J3z are x(t) = ce*" and 


y(t) = cze*’. Thus, the orbits are of the form (x(t), y(t)) = e*(c1, c2) and hence 
are rays from the origin through the initial condition (c;, cz). The origin is called a 
star node. Now refer to Fig. 9.5 for the phase portrait for each of the following two 
subcases: 


1. If A <0, then x(t) and y(t) approach zero as x gets large. All trajectories point 
toward the origin. In this case, the origin is a stable star node. 

2. If A > 0, then x(t) and y(t) approach infinity as x gets large. All trajectories 
point away from the origin. In this case, the origin is an unstable star node. 


J4 : By acalculation similar to the one done in Example 5, it is easy to see that the 
solutions to z’ = J3z are x(t) = e™ (cy cos Bt — c7 sin Bt) = |e|e™ cos(Bt + ¢) 
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A<0 A>O0 
stable star node unstable star node 


Fig. 9.5 Phase portrait for the canonical system J3 


a<0 a=0 a>dO 
stable spiral node center unstable spiral node 


Fig. 9.6 Phase portrait for the canonical system J4 


and y(t) = e” (c, sin Bt + cy cos Bt) = |c| e“ sin(Bt +), where |e| = ,/c? + c} 
and @¢ is the angle made by the vector (cj, c2) and the x-axis. From this it follows 
that 

x? 4 y? = le| e2at 


and the trajectories are spirals if a 4 0. Now refer to Fig. 9.6 for the phase portrait 
for each of the following three subcases: 


1. Ifa < 0, then x(t) and y(t) approach zero as ¢ gets large. Thus, the trajectories 
point toward the origin; the origin is called a stable spiral node. 

2. If a = 0, then x? + y? = |e|* and the trajectories are circles with center at the 
origin; the origin is simply called a center. 

3. If a > 0, then x(t) and y(t) approach infinity as ¢ gets large. Thus, the 
trajectories point away from the origin; the origin is called a unstable spiral 
node. 
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Classification of Critical Points 


Now let A be any nonsingular matrix. The critical point (0, 0) is classified as a node, 
center, or saddle according to whether the critical point in its affine equivalent is a 
node, center, or saddle. In like manner, we extend the adjectives proper, improper, 
stable, unstable, spiral, and star. Thus, in Example 1, the origin is an unstable 
node, and in Example 5, the origin is stable spiral node. Below we summarize the 
classification of the critical points in terms of the eigenvalues of A. 


Classification of critical points 
Jordanform Eigenvalues of A Critical point 
J 1G Ay x Ad 
Ay <A2 <0 Stable node 
A <O0< Ar Saddle 
0<A, <A, Unstable node 
Jn: Xr x 0 
4 <0 Stable improper node 
A>0 Unstable improper node 
J 35 ny x 0) 
A<0 Stable star node 
A>0 Unstable star node 
Ja: a+ip, B>0 
a<0 Stable spiral node 
a=0 Center 
a>0 Unstable spiral node 


Example 6. Classify the critical points for the system z’ = Az where 


ae | ee Saal" 4 3. A= =. 
—4° 4 a7 <1 4 3 


> Solution. 1. In Example 4 part (1), we found that A is of type J; with positive 
eigenvalues, A; = 4 and Az = 9. The origin is an unstable node. 

2. In Example 4 part (2), we found that A is of type J2 with single eigenvalue, 
A = —3. Since it is negative, the origin is an improper stable node. 

3. In Example 4 part (3), we found that A is of type J4 with eigenvalue, A = —1 + 
47. Since the real part is negative, the origin is a stable star node. < 
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Exercises 


1-10. For each of the following matrices A determine an affine transformation P 
and a Jordan matrix J so that J = P~'AP. Then classify the critical point of A. 


2. a=|3 Al 
=: 
af 29 
saa[S 2] 
4a=i z 
Ae 29 
2 0 
sal? 9 
4 1 
A= 
s4=| 1 3 
5 3 
nan[ 53 
1 2 
A= 
s4=[i | 
3 1 
A= 
4=| 5 | 


3 «40 
10. A= 

fo 
11-14. In the following exercises we examine how an affine transformation 
preserves basic kinds of shapes. Let P be an affine transformation. 


11. The general equation of a line is Du + Ev + F = 0, with D and E not both 
zero. Show that the change of variable z = Pw transforms a line L in the (u, v) 
plane to a line P(L) in the (x, y) plane. If the line goes through the origin show 
that the transformed line also goes through the origin. 

12. The general equation of a conic section is given by 


Aw + Buv+Cv + Du+ Ev+ F =0, 


where A, B, and C are not all zero. Let A = B” — 4AC be the discriminant. 
If 


1. A < 0 the graph is an ellipse. 
2. A = 0 the graph is a parabola. 
3. A > 0 the graph is a hyperbola. 
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Show that the change of variable z = Pw transforms an ellipse to an ellipse, a 
parabola to a parabola, and a hyperbola to a hyperbola. 

13. Suppose C is a power curve, i.e., the graph of a relation Au + Bv = (Cu+ 
Dv)?, where p is a real number and the variables are suitably restricted so the 
power is well defined. Show that P(C) is again a power curve. 

14. Suppose C is a differentiable curve with tangent line L at the point (uo, vo) in 
the (u, v) plane. Show that P(Z) is a tangent line to the curve P(C) at the point 
P(uo, Vo). 


15-19. In this set of exercises we consider the phase portraits when A is non zero 
but singular. Thus assume det A = 0 and A # 0. 


15. Show that A is similar to one of the following matrices: 


0 0 0 0 
a=[i 1449 or = [1 of 


(Hint: Since 0 is an eigenvalue consider two cases: the second eigenvalue is 
nonzero or it is 0. Then mimic what was done for the cases J; and J> in 
Theorem 2.) 


16. Construct the Phase Portrait for J; = ki i 


0 A 
17. Construct the Phase Portrait for Jz = 1 ; : 


18. Suppose det A = 0 and A is similar to J;. Let A be the nonzero eigenvalue. 
Show that the phase portrait for A consists of equilibrium points on the zero 
eigenspace and half lines parallel to the eigenvector for the nonzero eigenvalue 
A with one end at an equilibrium point. If A > 0 then the half lines point away 
from the equilibrium point and if A < 0 they point toward the equilibrium 
point. 

19. Suppose det A = 0 and A is similar to J;. Show that the phase portrait for A 
consists of equilibrium points on the zero eigenspace and lines parallel to the 
eigenspace. 


20-23. In this set of problems we consider some the properties mentioned in the text 
about the canonical phase portrait Jz. Let (c1, c2) be a point in the plane but not on 


the y axis and let A 4 0. Let y = = In (=) + ae 
Cl Cl 


20. If c; > 0 show ee Seana <0 Jim y=0. 


21. Show that y has a averted tangent at the Suit 

22. Show that y has a single critical point. 

23. Assume c; > 0 and hence x > 0. Show y is concave upward on (0, co) ifA > 0 
and y is concave downward on (0, co) if A < 0. 
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9.7 General Linear Systems 


In this section, we consider the broader class of linear differential systems where 
the coefficient matrix A(t) in 


y(t) = AMYO + FO (1) 


is a function of ¢ and not necessarily a constant matrix. Under rather mild conditions 
on A(t) and the forcing function f(t), there is an existence and uniqueness 
theorem. The linearity of (1) implies that the structure of the solution set is very 
similar to that of the constant coefficient case. However, it can be quite difficult to 
find solution methods unless rather strong conditions are imposed on A(t). 


An Example: The Mixing Problem 


The following example shows that a simple variation of the mixing problem 
produces a linear differential system with nonconstant coefficient matrix. 


Example 1. Two tanks are interconnected as illustrated below. 


Tank1 Tank2 


Assume that Tank 1 initially contains 1 liter of brine in which 8 grams of salt are 
dissolved and Tank 2 initially contains | liter of pure water. The mixtures are then 
pumped between the two tanks, 1 L/min from Tank | to Tank 2 and 1 L/min from 
Tank 2 back to Tank 1. Assume that a brine mixture containing 6 grams salt/L enters 
Tank 1 at a rate of 2 L/min, and the well-stirred mixture is removed from Tank 1 at 
the rate of 1 L/min. Assume that a brine mixture containing 10 grams salt/L enters 
Tank 2 at a rate of 2 L/min and the well-stirred mixture is removed from Tank 2 at 
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the rate of 1 L/min. Let y,(¢) be the amount of salt in Tank | at time ¢ and let y>(t) 
be the amount of salt in Tank 2 at time ¢. Determine a linear differential system that 
describes how y, y2, and their derivatives are related. 


> Solution. In this example, the amount of brine solution is not constant. The 
net increase of brine in each tank is one liter per minute. Thus, if v,(¢) and v2(t) 
represent the amount of brine in Tank 1 and Tank 2, respectively, then v\(¢) = 


v2(t) = 1+ ¢. Further, the concentration of salt in each tank is given by * 1 and 


I+t 
2 . As usual, y; and y5 are the differences between the input rate of salt and the 


output rate of salt, and each rate is the product of the flow rate and the concentration. 
The relevant rates of change are summarized in the following table. 


From To Rate 
Outside Tank1 (6 g/L)-(2 L/min) = 12g/min 
f t 
Tank 1 Outside (22 el) -(iL/min) = a ) git 


(L/min) = ae g/min 


n.)- = 
) 


Tank 1 Tank2 ( 1 af 


t 
(1 L/min) = zak g/min 


Tank 2 Tank 1 ( 7 @ g/L 


t 
Tank 2 Outside (ee ) of i.) 1 L/min vat g/min 


Outside Tank 2 (10 g/L) - (2 L/min) 


ll 


20 g/min 


The input and output rates are given as follows: 


Tank Input rate Output rate 
1 + 20 2m 
1+t 1+t 
> 9 + NO 2y2(t) 
1+t 1+t 
We thus obtain 
@) = yi) + ——y) + 12 
Vi) = parca 1 722 ; 
5(t) = t) - t) + 20. 
y3(t) ip rr, 


The initial conditions are y;(0) = 8 and y2(0) = 0. We may now write the linear 
differential system in the form 


y =At)yt)+ f(t), yO) = yo, 
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where 
2 4 
iat. 19 12 8 
@=|'F TS, ro=[S]. and xo =[F) 
(ae (9 


We will show how to solve this nonconstant linear differential system later in this 
section. < 


The Existence and Uniqueness Theorem 


The following theorem is the fundamental result for linear systems. It guarantees 
that solutions exist, and if we can find a solution to a initial value problem by any 
means whatsoever, then we know that we have found the only possible solution. 


Theorem 2 (Existence and Uniqueness). ’ Suppose that the n xn matrix function 
A(t) and the n x | matrix function f (t) are both continuous on an interval I in R. 
Let tg € I. Then for every choice of the vector yo, the initial value problem 


y=AOy+ flO, yo) = Yo 


has a unique solution y(t) which is defined on the same interval I. 


Remark 3. How is this theorem related to existence and uniqueness theorems we 
have stated previously? 


e If A(t) = A is aconstant matrix, then Theorem 2 is precisely Theorem 2 of Sect. 
9.5 where we have actually provided a solution method and a formula. 

¢ Ifn = 1, then this theorem is just Corollary 8 of Sect. 1.5. In this case, we 
have actually proved the result by exhibiting a formula for the unique solution. 
However, for general n, there is no formula like (15) of Sect. 1.5, unless A(t) 
satisfies certain stronger conditions. 

¢ Theorem 6 of Sect. 5.1 is a corollary of Theorem 2. Indeed, ifn = 2, 


_| 2 t _|{ 0 _ | 2 H 
A a ago(t ay(t ’ a ’ — ’ d — yr}? 
(t) 2 ai f(t) | i | Yo bs and y : 


TA proof of this result can be found in the text An Introduction to Ordinary Differential Equations 
by Earl Coddington, Prentice Hall, (1961), Page 256. 
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then the second order linear initial value problem 


ax(t)y” +ai(t)y’ +ao(t)y = f(t), y(to) = yo. y(t.) = 1 


has the solution y(t) if and only if the first order linear system 
Vy =A)yY+fO, Yt) = Yo 


y(t) 


has the solution y(t) = 
y'(t) 


| You should convince yourself of the validity of 


this statement. 


Linear Homogeneous Differential Equations 


In Theorem 4 of Sect. 9.2, we showed that each solution to (1) takes the form y = 
Yh + Yp» where y,, is a solution to the associated homogeneous system 


y(t) = AW) y@) (2) 


and y, is a fixed particular solution. We now focus on the solution set to (2). 


Theorem 4. /fthe nxn matrix A(t) is continuous on an interval I, then the solution 
set to (2) is a linear space of dimension n. In other words, 


1. There are n linearly independent solutions. 
2. Given any set of n linear independent solutions {6,6 ,...,@,,}, then any other 
solution @ can be written as 


vi) = cig, ee CrP p 


for some scalars c, ..., Cn € R. 


Proof. Let e; be the n x | matrix with 1| in the ith position and zeros elsewhere. By 
the existence and uniqueness theorem, there is a unique solution, w;(f), to (2) with 
initial condition y(¢o) = e;. We claim {W,, W>,..., W,,} is linearly independent. To 
show this, let 


W(N=[Wi) wt) -- v0). 3) 
Then W is ann x n matrix of functions with W(t) = |W (to) tee ¥,, (to) | = 
[er see en| = I, the n x n identity matrix. Now suppose there are scalars 
C},..-,Cn Such that cpW, +-::+c,p, = 0, valid for allt ¢ 7. We can reexpress 


this as W(t)c = 0, where c is the column vector 
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Cl 
c=] :]. (4) 

Cn 
Now evaluate at f = ft to getc = Ic = W(t))c = O. This implies 
{W1,W>,.-.,W,,} is linearly independent. Now suppose that w is any solution to 


(2). Let n(t) = W(t) (to). Then y is a linear combination of w,,..., W,,, hence 
a solution, and n(fo) = W(to) W(t.) = Wo). Since y and wp satisfy the same 
initial condition, they are equal by the existence and uniqueness theorem. It follows 
that every solution, y(¢), to (2) is a linear combination of w,,..., w,, and may be 
expressed as 


y(t) = VO) y(t), (5) 
where y (fo) is the initial condition, expressed as a column vector. 
Now suppose that {@,,@5,...,@,} is any set of 1 linearly independent solutions 


of (2). We wish now to show that any solution may be expressed as a linear 
combination of {¢,,5,...,@,,}.° By (5), we have 


6; (t) = ¥(t)G; (to), 
for eachi = 1,...,n. Let B(t) be the n x n matrix given by 
P()=[$10) $2) + $,0]- (6) 


Now we can write 
P(t) = W(t) P(t). 


We claim ® (fo) is invertible. Suppose not. Then there would be a column matrix c 
as in (4), where c),...,C, are not all zero, such that ®(t9)c = 0. But this implies 


C19, (t) +++ + nb, (t) = O(t)e = W(t) P(H)e = 0. 


This contradicts the linear independence of {@,,..., @,,}. It follows that ® (to) must 
be invertible. We can thus write 


W(t) = G(1)(P(t))*. (7) 
Now suppose @ is a solution to (2). Then (5) and (7) give 


(t) = W(t) (to) = B(t)(H (to) 'O(o), 


which when multiplied out is a linear combination of the @,,...,@,. Oo 


8This actually follows from a general result in linear algebra. 
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We will say that an n x n matrix function ®(t) is a fundamental matrix for a 
homogeneous system y’(t) = A(t)y(t) if its columns form a linearly independent 
set of solutions, as in (6). A matrix function W(t) is the standard fundamental 
matrix at t = to if it is a fundamental matrix and W(t)) = J, the n x n identity 
matrix, as in (3). Given a fundamental matrix ®(¢) Theorem 4, shows that the 
solution set to the homogeneous system y/(t) = A(t)y(t) is the span? of the 
columns of @(t). 


Theorem 5. Suppose A(t) is ann xn continuous matrix function on an interval I. 
A matrix function © (t) is a fundamental matrix for y'(t) = A(t) y(t) if and only if 


@'(t) = A(t) @(t) and det @(t) £0, 


for at least one t € I. If this is true for one t € I, it is in fact true for allt € I. 
The standard fundamental matrix W(t) at t = to is uniquely characterized by the 
equations 


W'(t)= A(t)W(t) and W(t) = 1. 


Furthermore, given a fundamental matrix ®(t), the standard fundamental matrix 
W(t) att = to is given by the formula 


W(t) = Bt) (PH). 


Proof. Suppose ®(t) = [, tee | is a fundamental matrix for y’(t) = 
A(t) y(t). Then 


®'(t)=[¢,0) -- HO] 
=[AM,0) + AO, (] 


=A(t)[o() --- $,(0] 
= A(t)®(t). 


As in the proof above, ® (to) is invertible which implies det ® (to) 4 0. Since fo € I 
is arbitrary, it follows that (t) has nonzero determinant for all t € Z. Now suppose 
that @(t) is a matrix function satisfying ®’(t) = A(t)@(t) and det O(t) F 0, for 
some point, ¢ = f say. Then the above calculation gives that each column @; (f) 
of ®(t) satisfies @)(t) = A(t)P(t). Suppose there are scalars c),...,C, such that 
c1@, +++: + cng, = 0 asa function on J. If ¢ is the column vector given as in (4), 
then 


® (to)c = C16, (to) +--+ + nd, (to) = O. 


Recall that “span” means the set of all linear combinations. 
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Since det 6 (to) 4 0, it follows that @ (to) is invertible. Therefore, c = 0 and ®(f) is 
a fundamental matrix. Now suppose ¥; and W> are standard fundamental matrices 
at to. As fundamental matrices, their ith columns both are solutions to y/(t) = 
A(t) y(t) and evaluate to e; at fo. By the existence and uniqueness theorem, they are 
equal. It follows that the standard fundamental matrix is unique. Finally, (7) gives 
the final statement W(t) = B(t) (® Gil): Oo 


In the case A(t) = A is a constant, the matrix exponential e“’ is the standard 
fundamental matrix at ¢ = 0 for the system y’ = Ay. This follows from 
Lemma 9.5.1. More generally, e4@—) is the standard fundamental matrix at tf = to. 


e2! e! 
eo=[o 2] 


is a fundamental matrix for the system y’ = E i y. Find the standard 


Example 6. Show that 


fundamental matrix at t = 0. 


> Solution. We first observe that 
e2t et 7 e2t et 
#'(t) = he 2 = re et 
0 1 ef et 2e2 —e7! 
© 5 i fe Bel be | 
Thus, @’(t) = A®(t). Observe also that 


eo=[h 


and this matrix has determinant —3. By Theorem 5, ®(f) is a fundamental matrix. 
The standard fundamental matrix at t = 0 is given by 


and 


W(t) = (1) (G(0)) 
= e2! e!]f1 ‘7 
~ |2e e112 -1 
fe e*)f-t =1 
~ 3|2e -e]|2 1 


1 e2! 4 Qe! e2t _ z 


3|2e%2e*  2e** 4 et 
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The reader is encouraged to compute e“’ where A = 5 A and verify that 


W(t) =e". < 
Example 7. Show that 
PP «P 
P(t) = 
©) a | 


is a fundamental matrix for the system y’ = A(t)y where 


0 1 
a=: he FH 


Solve the system with initial condition y(1) = EI Find the standard fundamental 
matrix att = 1. 


> Solution. Note that 


2 2 3 
oe EB a = ze | B A ASO); 


while 


det ®(1) = E i =140. 


Hence, ®(f) is a fundamental matrix. The general solution is of the form y(t) = 


Cl 


@(t)c, where c = i The initial condition implies 
c 


-[ sll) = ba) 


Solving for ¢ gives cj = 2 and cp = 1. Thus, 


t? i 24+ 23 
x) by bs | ke + M4 


The standard fundamental matrix is given by 


-1 
von = eno =|) | E 


2 


2t 30? 
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_fe ey] 3 -1 
~ 12t 3f2}}-2 1 
_ 73-28 -P +h 
666 29¢- 377 |" 


Observe that ®(0) = k | which has determinant 0. Why does this not prevent 
®(t) from being a fundamental matrix? < 


You will recall that in Sect.9.5, we used the inverse of the matrix exponential 
(e!4) = e4 as an integrating factor for the constant coefficient system y’ = 
Ay + f.. As observed above, the matrix exponential e'4 is the standard fundamental 
matrix at t = 0. In the more general context, we will show that the inverse of any 
fundamental matrix ® (f) is an integrating factor for the system y’(t) = A(t)y(t)+ 
f (t). To show this, however, particular care must be taken when calculating the 
derivative of the inverse of a matrix-valued function. 


Lemma 8. Suppose ®(t) is a differentiable and invertible n x n matrix-valued 
function. Then 


d -1 —-lqg’ -l 
qo ey Pe ew): 


Remark 9. Observe the order of the matrix multiplications. We are not assuming 
that ®(t) and its derivative ®’(¢) commute. 


Proof. We apply the definition of the derivative: 


d 1 (@U +h) -(@@)* 
red 2) Jim h 
! eon ees) (@(t))! 


@(t +h)— G(t) 


= lim @@ +h) 


=— (0 +h)" tim (@(1))" 


= -(@(1)) 1 O'(HEM)". 


The second line is just a careful factoring of the first line. To verify this step, simply 
multiply out the second line. Oo 


If ®(t) is a scalar-valued function, then Lemma 8 reduces to the usual chain rule 


formula, $(@(t))~! = —(@(t))-7'(t), since ® and &’ commute. For a matrix- 


valued function, we may not assume that ® and ® commute. 
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Nonhomogeneous Linear Systems 


We are now in a position to consider the solution method for the general linear 
system y(t) = A(t)y(t) + f(t) which we write in the form 


y'(t)- Ay) = f(). (8) 


Assume A(t) and f(t) are continuous on an interval J and an initial condition 
y(to) = Yo is given. Suppose ®(f) is a fundamental matrix for the associated 
homogeneous system y(t) = A(t)y(t). Then (@(¢))~! will play the role of an 
integrating factor and we will be able mimic the procedure found in Sect. 1.4. First 
observe from Lemma 8 and the product rule that we get 


(((0)) yD)’ = (@O)'y'(H) -@O)'18'OEO) 190 
= (G0) yD) —(@O)TAMDPOEO) yO 
= (@(t))"y') — (OM) AMY) 
= (G1) '(y'() — AD). 


Thus, multiplying both sides of (8) by (@(t))~! gives 
plying ry g 


(G0) "'y()) = (@M) F/O. 


Now change the variable from f to u and integrate both sides from fy to tf where 
t € I. We get 


[ (wry wy w= | ew" Fw au. 
The left side simplifies to (®(t)' y(t)) — (® (to) y (to). Solving for y(t), we get 


y(t) = O(t)(G(t)) "yo + 0.) | (@(u))' f (wu) du. 


It is convenient to summarize this discussion in the following theorem. 


Theorem 10. Suppose A(t) is ann xn matrix-valued function on an interval I and 
Ff () is a R"-valued valued function, both continuous on an interval I. Let ®(t) be 
any fundamental matrix for y'(t) = A(t)y(t) and let to € I. Then 


y(t) = G(t)(P(t))' yo + ow) | (@(u))' f (u) du, (9) 
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is the unique solution to 


y(t) =AMYG) + f@. Y(to) = Yo. 


Analysis of the General Solution Set 


The Particular Solution 


When we set yy = 0, we obtain a single fixed solution which we denote by y,,. 
Specifically, 


yp(t) = O(0) i (®(w)"f (w) du. (10) 


This is called a particular solution. 


The Homogeneous Solution 


When we set f = 0, we get the homogeneous solution y,,. Specifically, 


Vy(t) = G(t)(H()) yo. (11) 


Recall from Theorem 5 that the standard fundamental matrix at fo is W(t) = 
®(t)(®(to))~'. Thus, the homogeneous solution with initial value y,(to.) = yo 
is given by 
Jp) = YOY. 

On the other hand, if we are interested in the set of homogeneous solutions, then we 
let yo vary. However, Theorem 5 states the ® (fo) is invertible so as yy varies over 
IR”, so does (®(to))~ | yo. Thus, if we let c = (®(to))~! yo, then we have that the 
set of homogeneous solution is 


{P(t)e:c ER}. 


In other words, the set of homogeneous solution is the set of all linear combinations 
of the columns of ®(t), as we observed earlier. 


Example 11. Solve the system y(t) = A(t)y(t) + f (t) where 


0 1 t? 
so-[ be di] r0-[ 
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> Solution. In Example 7, we verified that 


2 3 
e0=[3 32 


is a fundamental matrix. It follows that the homogeneous solutions are of the form 


i? - 
VYniO) =e B + c2 | ; 


where c; and C2 are real scalars. To find the particular solution, it is convenient to 
set fg = 1 and use (10). We get 


t 
yplt) = 90) i (Bw) f (w) du 
1 
t Os 2 
=o | oth He "| du 
1 [-2/u 1/u Uu 
; 2, 
of a " 
_fe #)]/2¢-) 
~ 12t 32? —Int 
— f2e-20—-f Int __5 r “5 2 i — Int 
~ 14? —4¢ — 32? Int |] of 3t? =37° = 3F Int|” 
It follows that the general solution may be written as 


Y(t) = y,) + yO) 


i. r —int 
= (c) -2 2 
ae A ere) | - ae - cal 


t? 1 —t Int 
=C C ; 
; Lon be Ei ’ Fe - ie 


where the last line is just a relabeling of the coefficients. In Example (7), we 
computed the standard fundamental matrix W(t). It could have been used in place 
of ®(f) in the above computations. However, the simplicity of ®(t) made it a better 
choice. < 


This example emphasized the need to have a fundamental matrix in order to go 
forward with the calculations of the particular and homogeneous solutions, (10) 
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and (11), respectively. Computing a fundamental matrix is not always an easy task. 
In order to find a closed expression for it, we must place strong restrictions on the 
coefficient matrix A(t). Let us consider one such restriction. 


The Coefficient Matrix is a Functional Multiple of a Constant 
Matrix 


Proposition 12. Suppose a(t) is a continuous function on an interval I. Let 
A(t) = a(t)A, 


where A is a fixed n x n constant matrix. Then a fundamental matrix, ®(t), for 
y'(t) = A(t) y(t) is given by the formula 


(1) = POA (12) 
where b(t) is an antiderivative of a(t). If b(t) = fia a(u) du, that is, b(t) is chosen 
so that b(to) = 0, then (12) is the standard fundamental matrix at to. 


Proof. Let 


2 2 
@(t) = POA = T+ d(t)At e oe 


aes 


Termwise differentiation gives 


@'(t) = b'(t)A + 2b(t)b’ oF + 3b7(t)b! oo +: 


=a(t)A (1 + b(t)A+ z = + ) 
= A(t)@(t). 


Since the matrix exponential is always invertible, it follows from Theorem 5 that 
@(t) is a fundamental matrix. If b(t) is chosen so that b(t) = 0, then ®(t) = 
e4"| <0 = I, and hence, ®(f) is the standard fundamental matrix at fo. oO 


Remark 13. We observe that ®(t) may be computed by replacing u in e“4 with 
b(t). 


Example 14. Suppose A(t) = (tant)A, where 


[i 


Find a fundamental matrix for y’(t) = A(t) y(t). Assume t € (—3, 5). 
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> Solution. We first compute e“”. The characteristic polynomial is 


s—2 3 


c4(s) = det(sI ~ A) = det] i a 


=s?-1=(s—1)(s+ 1). 
It follows that 6., = {e“,e~“}. Using Fulmer’s method, we have e4” = eM, + 
e “M). Differentiating and evaluating at u = 0 gives 

IT=M,+™), 

A= M, — Md. 


3. 3 


It follows that M, = 5(A +1) = :| ; 


5 =) . Thus, 
1 3 
1 3 3 —-l -3 
Au _ =~ ,u —u 
e =" 1 il+e E At 
Since In sec ¢ is an antiderivative of tant, we have by Proposition 12 


1 3 3 1_ —-1 -3 
@(t)=— Insect = Insect 
w= 5° E Ee oa 1 ; 


| a ms = 57 - A) = 


1] 3sect—cost 3sect—3cost 
2|—sect+cost —sect+3cost|’ 


is the fundamental matrix for y(t) = A(t) y(t). < 


Example 15. Solve the mixing problem introduced at the beginning of this section. 
Specifically, solve 


y =At)yt)+ f(t), yO) = yo, 


where 


A= |" ro=[ 5]. and TONE 


Determine the concentration of salt in each tank after 3 minutes. In the long term, 
what are the concentrations of salt in each tank? 


2 1 


> Solution. Let a(t) = a" Then A(t) = a(t)A where A = ie 5 


]-™ 


characteristic polynomial of A is 
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s+2 —l1 


ca(s) = de(s1 ~ A) = det 1 542 


= (s + 1)(s + 3). 


A short calculation gives the resolvent matrix 


oe 1 s42. 1 
ae, = soe | 1 | 


1 tilt 1 Le | 
~ As+)D1 1) ° 264+3)[-1 1 


ow eo" [1 Pe ee tf <1 
~ 241 1 2 |-1 1] 


Since In(t + 1) is an antiderivative of a(t) = > we have by Proposition 12 


and hence 


= 


@(t) = ent +14 
7 eo M+D Ty 4 z e3(in(t+1)) C4 
ae 1 1 2 -1 1 


_ ali it 1 bal 
~ 2¢47) (1° 1) ° 2@418 |= 4 
_ 1 (¢+1)?4+1 eae | 
WELT LEST SH) ely +1 


a fundamental matrix for y’(t) = A(t)y(t). Observe that ®(0) = I is the 2 x 2 
identity matrix so that, in fact, ®(t) is the standard fundamental matrix at t = 0. 
The homogeneous solution is now easily calculated: 


Yn) = (Dy 


1 ((+1)?+1 (t+1)?-1][8 
eee eae 


_ 4 (¢(+1)?+1 
tee Pe ae 12 = 1] 


A straightforward calculation gives 


(@()"! = Sl ery el 


2 |1-(+1)? w4t1%+1 
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and 


4 _—utlf[utile+il 1-@w@+)?]/12 
ON TO 5 bees reeled 


_ fee 1)-—4(u+ | 
~ 1 16(u+ 1) + 4(ut 13] 


For the particular solution, we have 
t 
yp(t) = 00) [wr F au 


8(u+ 1)? -(u+1)4 
@(t) 
8(u+ 1)? + (u+1)4 


t 


0 


g 1 (¢+1%+1 (+1)?-1][ 8@+1)?-(@4+1)1-7 
2G +13 | 42-1 + )24+1) [80412 + (4+ 4-9 


ro abl ea 
~ ¢+13 | 9¢ + 1)4- 8 +1)? -1]° 


Putting the homogeneous and particular solutions together gives 


y(t) = y, 0) + ¥,) 


_ 4 apd) Pt] s. 1 7¢+1)*-—8¢ +1)? +1 
~ (¢@ +13 L@+1%-1]) ¢€ 412 £94 14-804 17-1 


x aps il Ee a ee ae 
~ +13 19¢+ Dt-4(t +1? - 5] 


Finally, the amount of fluid in each tank is vi(t) = vo(t) = ¢t + 1. Thus, the 
concentration of salt in each tank is given by 


1 2 W(t +1)*-4(¢ +1)? +5 
ras Law 


(¢ +1941 9¢+1)4-40 4 1)?-5]° 


Evaluating at f = 3 gives concentrations 


1733 

ie _ a 
2235 7 
228 8.73 
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In the long term, the concentrations are obtained by taking limits 


ee ees 4(¢+1)° +5] [7 
100 (t + If o¢+1*-4¢41)?—-5] 19] ° 


Of course, the tank overflows in the long term, but for a sufficiently large tank, 
we can expect that the concentrations in each tank will be near 7g/L and 9g/L, 
respectively, for large values of f. | 
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9.7 General Linear Systems 719 
Exercises 


1-7. For each of the following pairs of matrix functions ®(t) and A(t), verify that 
@(t) is a fundamental matrix for the system y’ = A(t)y. Use this fact to solve 
y’ = A(t)y with the given initial conditions y(t) = yo. Next, determine the 
standard fundamental matrix at fo. 


eo-le) Zhan-3  v0-[ 


2. rls el aw) =[3 ho=[1] 


_ Fsin@?/2) — cos(r?/2) hip on ah 
a = [e1 Bee ae & Al y(0) = | 
air - : +t t t _ [4 

4. &(t) = be ih A(t) = E : J} 2@= | 
tcost -—tfsint _ fist I fa 
aa I" t sint is aw = [V4 ah yin) =|_1| 


a ie t? _ {14+2t 2t _ it 
o eo=e'| | ak aw) =| ~2t | vo =| 5) 


7. eo=| — er a ee veh wo=[ 


8-12. For each problem below, compute the standard fundamental matrix for the 
system y’(t) = A(t) y(f) at the point given in the initial value. Then solve the initial 
value problem y’(t) = A(t)y(t) + f ). y(to) = Yo. 


s ao=-[5 of ro=[;} xo =[)] 
9. a= 7]? 5} £0=[ a} eo -[F] 
10. A(t) = aie ‘ =} ro= [> al v= |_| 


11. AG) = ES al fO= a y= H 


sect —3sect 


2.ao=[{ 1!) ro=[%] xo=[9) 
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13-14. Solve the following mixing problems. 


13. Two tanks are interconnected as illustrated below. 


Tank 1 Tank 2 


Assume that Tank | contains 2 Liters of pure water and Tank 2 contains 2 Liters 
of brine in which 20 grams of salt is initially dissolved. Moreover, the mixture 
is pumped from each tank to the other at a rate of 1 L/min. Assume that a brine 
mixture containing 6 grams salt/L enters Tank | at a rate of 1 L/min and pure 
water enters Tank 2 at a rate of 1 L/min. Assume the tanks are well stirred. Brine 
is removed from Tank | at the rate 2 L/min and from Tank 2 at a rate of 2 L/min. 
Let y(t) be the amount of salt in Tank 1 at time ¢ and let y2(t) be the amount 
of salt in Tank 2 at time ¢. Determine y; and yz. What is the concentration of 
salt in each tank after 1 minute? 

14. Two tanks are interconnected as illustrated below. 

L L 


min 2 min 


Tank 1 Tank 2 


Assume initially that Tank | contains 2 Liters of pure water and Tank 2 contains 
1 Liter of pure water. Moreover, the mixture from Tank | is pumped into Tank 2 
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at a rate of 3 L/min and the mixture from Tank 2 is pumped into Tank 1| at a rate 
of 1 L/min. Assume that a brine mixture containing 7 grams salt/L enters Tank | 
at a rate of 4 L/min and a brine mixture containing 14 grams salt/L enters Tank 
2 at arate of 2 L/min. Assume the tanks are well stirred. Brine is removed from 
Tank 2 at the rate 3 L/min. Let y;(t¢) be the amount of salt in Tank | at time ¢ 
and let y2(¢) be the amount of salt in Tank 2 at time ¢. Determine y; and yo. 
Find the concentration of salt in each tank after 3 minutes. Assuming the tanks 
are large enough, what are the long-term concentrations of brine? 


Appendix A 
Supplements 


A.1 The Laplace Transform is Injective 


In this section, we prove Theorem | of Sect. 2.5 that states that the Laplace transform 
is injective on the set of Laplace transformable continuous functions.! Specifically, 
the statement is 


Theorem 1. Suppose fi and fz are continuous functions on [0,00) and have 
Laplace transforms. Suppose 


Lifts = Lt fh}. 


Then fi = fr. 


The proof of this statement is nontrivial. It requires a well-known result from 
advanced calculus which we will assume: the Weierstrass approximation theorem. 


Theorem 2 (The Weierstrass Approximation Theorem). Suppose h is a contin- 
uous function on [0, 1]. Then for any € > 0, there is a polynomial p such that 


|A(t) — p()| <€, 


for allt in (0, 1]. 


In essence, the Weierstrass approximation theorem states that a continuous 
function can be approximated by a polynomial to any degree of accuracy. 


'The presentation here closely follows that found in Advanced Calculus by David Widder, 
published by Prentice Hall, 1961. 


W.A. Adkins and M.G. Davidson, Ordinary Differential Equations, 723 
Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-3618-8, 
© Springer Science+Business Media New York 2012 
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Lemma 3. Suppose h(t) is a continuous function so that 


1 
/ t"h(t) dt = 0, 


0 


for each nonnegative integer n. Then h(t) = 0 for allt € [0, 1]. 


Proof. Let é€ > 0. By the Weierstrass approximation theorem, there is a polynomial 
p so that 

|A(t) — p()| <€, 
for all ¢ in [0, 1]. Since a polynomial is a linear combination of powers of f, it follows 
by the linearity of the integral that if. p(t)h(t) dt = 0. Now observe, 


1 1 
i. (h(t)? dt = i h(t)(h(t) — p(t) dt 
0 0 


IA 


1 
/ la(t)| |a(t) — pl at 


1 
f |h(t)| de. 


Since € is arbitrary, it follows that fe (h(t))* dt can be made as small as we like. 
This forces iG (h(t))* dt = 0. Since (h(t))” > 0, it follows that (h(t))? = 0, for all 
t € [0, 1]. Therefore, h(t) = 0 for all t € [0, 1]. Oo 


IA 


Theorem 4. Suppose f is a continuous function on the interval |0,00), F(s) = 
L{f(t)}(s) fors > aand F(a+nl) = 0 foralln = 0,1,..., for some l > 0. 
Then f = 0. 


Proof. Let g(t) = 1 e “ f(u) du. Since F(a) = 0, it follows that lim g(t) = 0. 
too 
Write = as 
F(a +nl) = i e tad! Ft) dt = i ete f(t) dt 
0 0 


and compute using integration by parts with uw = e~”’" and dv = e“ f(t). Since 
du = —nle~""' and v = fi; e~* f(u) du = g(t), we have 


F(a+nl)= en g(r) | + nl [ e"" (t) dt. 
0 


[o.@) 
=n f e"" o(t) dt. 
0 
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Since F(a + nl) = 0 we have 


[o,@) 
; e" g(t) dt =0, 


0 


for alln = 1,2,.... Now let x = e7!'. Then dx = —le~'‘ dt = —/x dt and 
t= -+ Inx = ; In i. Substituting and simplifying, we get 


: n—1 1 1 
x" g{—In—] dx =0, 
0 i XxX 


for alln = 1,2,.... By Lemma 3, it follows that g (+ In +) = 0 for all x € [0, 1], 
and hence, g(t) = 0 on [0, 00). Since 0 = g’(t) = ec“ f(t) it follows now that 
F(t) = 0 for all t € [0, co). 


Proof (Proof of Theorem 1). Suppose f(t) = fi(t) — fo(t). Then L{f}(s) = 0 
for all s. By Theorem, 4 it follows that f is zero andso f, = fr. o 


A.2 Polynomials and Rational Functions 


A polynomial of degree n is a function of the form 
P(s) = a, 8" + Gpn—1s" ? +++++a,S + do, 


where a, #4 0. The coefficients ap,...,a, may be real or complex. We refer to 
a, as the leading coefficient. If the coefficients are all real, we say p(s) is a real 
polynomial. The variable s may also be real or complex. A root of p(s) is a scalar 
r such that p(r) = 0. Again r may be real or complex. If r is a root of p(s), then 
there is another polynomial p;(s) of degree n — 1 such that 


P(S) = (8 —1r)pi(s). 


The polynomial p;(s) may be obtained by the standard procedure of division of 
polynomials. 

Even though the coefficients may be real, the polynomial p(s) may only have 
nonreal complex roots. For example, s* + 1 only has i and —i as roots. Notice in 
this example that the roots are complex conjugates. This always happens with real 
polynomials. 


Proposition 1. Suppose p(s) is a real polynomial andr € C is a root. Then r is 
also a root. 


Proof. Suppose p(s) = a,s" +--+ + a,s + do, with each coefficient in R. We are 
given that p(r) = 0 from which follows 
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D(F) = Qnf" +--+ + air + a0 


= anr" +++ +07 +49 


Thus 7 is also a root. oO 


The fundamental theorem of algebra addresses the question of whether a 
polynomial has a root. 


Theorem 2 (Fundamental Theorem of Algebra). Let p(s) be a polynomial of 
degree greater than 0. Then p(s) has a rootr € C. 


The following corollary follows immediately from the fundamental theorem of 
algebra. 


Corollary 3. Let p(s) be a polynomial of degree n andn > 1. Then there are roots 
r1,.--51Tn € C such that 


P(S) = @n(s —11)--- (8 — Tn), 


where ay is the leading coefficient of p(s). 


Each term of the form s — r is called a linear term: if r € R it is a real linear 
term, and if r € C, it is a complex linear term. An irreducible quadratic is a 
real polynomial p(s) of degree 2 that has no real roots. In this case, we may write 
p(s) = as? + bs +c as a sum of squares by a procedure called completing the 
square: 


p(s) =as* +bs +c 


es) 
S=al\s o+—-s+— 
a a 


= prea a ea a 
— a 4a2 4a? 
( 2) (“=*) 
=a S+ + 
2a 2a 


=a((s—a)’ +B’), 


where we set a = -£ and Bp = vicaa "| From this form, we may read off the 
complex roots r = a +if andr = a —if. We further observe that as* + bs +c = 


a(s — (a + iB))(s — (a —iB)). 
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Corollary 4. [f p(s) is a real polynomial, then p(s) is a product of real linear terms 
or irreducible quadratics. 


Proof. By fundamental theorem of algebra, p(s) is a product of linear factors of 
the form s — r. By Proposition 1, we have for each nonreal linear factor s — ra 
corresponding nonreal factor s — 7 of p(s). As observed above, (s — r)(s — 7) is an 
irreducible quadratic. It follows then that p(s) is a product of real linear terms and 
irreducible quadratics. 


Corollary 5. Suppose p(s) is a polynomial of degree n and has m > n roots. Then 
p(s) = Oforalls €R. 


Proof. This is an immediate consequence of Corollary 3. oO 


Corollary 6. Suppose pi(s) and p2(s) are polynomials and equal for all s > A, 
for some real number A. Then p(s) = p2(s), for alls € R. 


Proof. The polynomial p;(s) — p2(s) has infinitely many roots so must be zero, 
identically. Hence, pi(s) = p(s) for alls € R. Oo 


A rational function is a quotient of two polynomials, that is, it takes the form 


Hae A rational function is proper if the degree of the numerator is less than the 


degree of the denominator. 


PAS) yg b2b5) 
qs) q2(s) 
s > A for some real number A. Then they are equal for all s such that qi(s)qa(s) # 


0. 


Corollary 7. Suppose are rational functions that are equal for all 


Proof. Suppose 
Pils) _ P2(s) 
qi(s) q2(s) 


for all s > A. Then 
Pi(s)q2(s) = pr(s)qils), 


for all s > A. Since both sides are polynomials, this implies that pi(s)q2(s) = 
P2(s)qi(s) for all s € R. Dividing by qi (s)q2(s) gives the result. Oo 


A.3 B, Is Linearly Independent and Spans €, 
B, Spans E, 


This subsection is devoted to a detailed proof of Theorem 2 of Sect. 2.7. To begin, 
we will need a few helpful lemmas. 
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Lemma 1. Suppose q(s) is a polynomial which factors in the following way: 
q(s) = qi(s)qn(s). Then 

By, C By, 

Rg C Rg, 

Eq, C Eq. 


(Of course, the same inclusions for qo are valid.) 


Proof. Since any irreducible factor (linear or quadratic) of q; is a factor of q, it 
follows by the way 6, is defined using linear and irreducible quadratic factors 
of q(s) that B,, C B,. Suppose pi(s)/gi(s) € Ry. Then pi(s)/qi(s) = 
Pi(s)q2(s)/qi(s)go(s) = pils)ga(s)/q(s) € Rg. It follows that Ry, C Ry. Finally, 
if f € €,, then £{f} € Ry, C Ry. Hence, f € E, and therefore Ej, C Ey. o 


Lemma 2. Let q(s) be a polynomial of degree n = 1. Then 
Bg C &. 


Proof. We proceed by induction on the degree of qg(s). If the degree of g(s) = 1, 
then we can write q(s) = a(s — A), and in this case, B, = eh: Since 


a a _ a 
Ee ae ae 


it follows that e’ € €,. Hence, B, C €,. Now suppose deg g(s) > 1. According to 
the fundamental theorem of algebra q(s) must have a linear or irreducible quadratic 
factor. Thus, ¢(s) factors in one of the following ways: 


1. q(s) = (s —A)*qu(s), where k > 1 and q(s) does not contain s — A as a factor. 
2. q(s) = ((s —a)* + B*)*qi(s), where k > 1 and qi(s) does not contain (s — 
a)? + B? asa factor. 


Since the degree of q, is less than the degree of g, we have in both cases by induction 
that B,, C €,,. Lemma | implies that By, C €,. 


Case 1: q(s) = (s —A)*qi(s). Let f € By be a simple exponential polynomial. 
Then either f(t) = t’e*", for some nonnegative integer r less thank, or f € By, C 
E,. If f(t) = t’e™ then, £{f} =r!/(s—A)'t! € Ris—ayrt1 C Rq by Lemma 1. 
Thus, f € €,, and hence B, C Ey. 


Case 2: q(s) = ((s — a)? + B*)‘qi(s). Let f € By. Then either f(t) = 
t’e™ trig Bt, where trig is sin or cos and r is a nonnegative integer less than k, 
or f € By C &. lf f(t) = te” trig Bt, then by Lemma 10 of Sect. 2.6, 
Lif (t)} © Res—ay24+p2)« and hence, by Lemma 1, £{f(¢)} € Rg. It follows that 
f € &. Hence B, C Ej. Oo 
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Proof (of Theorem 2 of Sect. 2.7). Since €q is a linear space by Proposition 2 of 
Sect. 2.6 and B, C €, by Lemma 2, we have 


Span By C &,. 


To show €& C Span By, we proceed by induction on the degree of g. Suppose 
deg q(s) = 1. Then q(s) may be written g(s) = a(s — A), for some constants 
a #Oandd € Rand B, = {e*"}. If f © &, then £L{f} = c/(a(s — A)), for 
some constant c, and hence, f = (c/a)e*’. So f € Span B, and it follows that 
€, = Span By. 

Now suppose deg qg > 1. Then q(s) factors in one of the following ways: 


1. g(s) = (s —A)‘qi(s), where k > 1 and q;(s) does not contain s — A as a factor. 
2. q(s) = ((s —a)* + B*)*qi(s), where k > 1 and q(s) does not contain (s — 
a)? + B? asa factor. 


Since the degree of q1, is less than the degree of g we have in both cases by induction 
that €,, = Span By,. 

Consider the first case: g(s) = (s —A)*qi(s). If f € &, then L { f} has a partial 
fraction decomposition of the form 


x i wack Ax pis) 


Liff(y= a. (s— ak als)’ 


5 


for some constants A;,..., A, and polynomial p;(s). Taking the inverse Laplace 
transform, it follows that f is a linear combination of terms in cae th eMt 
and a function in €,,. But since €,, = Span By, and B, = {e”’,...,t*'e} UB, 
it follows that f € Span B, and hence €, = Span By. 

Now consider the second case: q(s) = ((s — a)? + B?)‘qi(s). If f € &, then 
L{f}has a partial fraction decomposition of the form 


f°? 


Ais + By Axs + By Pils) 
L171) =s es ee 2 2)k , 
(s—a)? + B ((s— a)? + BY" gis) 

for some constants A,;,..., Ax, Bi,..., By and polynomial p;(s). Taking the 


inverse Laplace transform, it follows from Corollary 11 of Sect. 2.5 that f is a linear 
combination of terms in 


{e™ cos Bt,e™ sin Bt,..., t*'e™ cos Br, t*1e™ sin Br} 
and a function in €,. But since €,, = Span B,, and 
_ at at a: k-1 at k-1 at .: 
By, = {e cos Bt,e™ sin Bt,...,t" e” cos Bt, te sin Br} U Ba, 


it follows that f € Span B, and hence €, = Span B,. Oo 
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Let g(s) be a nonconstant polynomial. This subsection is devoted to showing that 
B, is linearly independent. To that end, we derive a sequence of lemmas that will 
help us reach this conclusion. 

Lemma 3. Suppose q(s) = (s — A)"qi(s) where (s — A) is not a factor of qi(s). 
Suppose fi € Eis—aym, fo € Eg,, and 


Ath =09. 


Then fi = Oand fr = 0. 


Proof. Let F\(s) = L{ fi} (s) and Fo(s) = L{ fo} (s). Then F,(s) = Ee. for 
some r < m and some polynomial p(s) with no factor of s — A. Similarly, Fo(s) = 


ai a , for some polynomial p;(s). Thus, 


P(s) Pils) _ 
(s—A)" — qil(s) 


(1) 


By Corollary 7 of Appendix A.2, equation (1) holds for all s different from A and 
the roots of qi(s). Since gi(s) contains no factor of s — A, it follows that q\(A) 4 0. 
Consider the limit as s approaches A in (1). The second term approaches the finite 
value pi(A)/qi(A). Since the sum is 0, the limit of the left side is 0 and this implies 
that the limit of the first term is finite as well. But this can only happen if p(s) = 0. 
It follows that F;(s) = 0 and hence f; = 0. This in turn implies that fp = 0. Oo 


Lemma 4. Suppose q(s) = ((s — a)? + B*)'""qi(s) where (s — a)? + B? is not a 
factor of qi(s). Suppose fi € E(s—w)4p2yn, f2 € Eq, and 


fit fr =0. 


Then f; = Oand fr = 0. 
Proof, Let F\(s) = £L{fi}(s) and Fy(s) = L{ fo} (s). Then F,(s) = wot 
for some r < mand some polynomial p(s) with no factor of (s—a)? +7. Similarly, 


F,(s) = aoe for some polynomial p;(s). Thus, 


p(s) pis) _ 


= 2. 
(Gap +B tT ais) = 


Again, by Corollary 7 of Appendix A.2, equation (2) holds for all s different from 
a +if and the roots of g;(s). Since qi(s) contains no factor of (s — a)? + B? 
it follows that gi(a@ + if6) # 0. Consider the limit as s approaches the complex 
number a + if in (2). The second term approaches a finite value. Since the sum is 
O, the limit of the left side is 0 and this implies that the limit of the first term is finite 
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as well. But this can only happen if p(s) = 0. It follows that F\(s) = 0 and hence 
ji = 0. This in turn implies that f; = 0. oO 


Lemma 5. Let g(s) = (s — A)”. Then B, is linearly independent. 


Proof. By definition, B, = {e*’, te*",...,1~ le". Suppose 
Coe oe bey at le* =O, 
Dividing both sides by e*’ gives 
Gy etyt deans ety ae =O, 


Evaluating the at t = O gives co = 0. Taking the derivative of both sides and 
evaluating at tf = 0 gives c; = 0. In general, taking the rth derivative of both sides 
and evaluating at t = 0 givesc, = 0, forr = 1,2,...,m = 1. It follows that all of 
the coefficients are necessarily 0, and this implies linear independence. oO 


Lemma 6. Let q(s) = ((s — a)* + B*)”. Then B, is linearly independent. 


Proof. By definition, By = {ew cos Bt, ewt sin Bt, ee pin—leat cos Bt, pleat 
sin Bt}. A linear combination of B, set to 0 takes the form 


pi(t)e™ cos Bt + pr(t)e™ sin Bt = 0, (3) 


where p, and pz are polynomials carrying the coefficients of the linear combination. 
Thus, it is enough to show p; and pz are 0. Dividing both sides of Equation (3) by 
e“ gives 

Pit) cos Bt + p2(t) sin Bt = 0. (4) 


2am 2am 


Let m be an integer. Evaluating att = a gives Pp ( B 


) = 0, since sin27m = 0 
and cos 27m = 1. It follows that p; has infinitely many roots. By Corollary 5, of 
Sect. A.2 this implies p; = 0. Ina similar way, p2 = 0. oO 


Theorem 7. Let g be a nonconstant polynomial. View By as a set of functions on 
I = [0, 00). Then B, is linearly independent. 


Proof. Let k be the number of roots of g. Our proof is by induction on k. If g has but 
one root, then g(s) = (s — A)” and this case is taken care of by Lemma 5. Suppose 
now that k > 1. We consider two cases. If g(s) = (s — A)"qi(s), where qi(s) 
has no factor of s — A, then a linear combination of functions in B, has the form 
filt) + folt), where fi(t) = coe! + +++ + Cm—it’” ee is a linear combination of 
functions in Bis—ayn and f(t) is a linear combination of functions in B,,. Suppose 


Aid) + folt) = 0. 


By Lemma 3, /; is identically zero and by Lemma 5, the coefficients co, ... , Cm—1 
are all zero. It follows that 2 = 0. Since q(s) has one fewer root than q, it follows 
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by induction the coefficients of the functions in B,, that make up /) are all zero. If 
follows that B, is linearly independent. 

Now suppose g(s) = ((s — a)? + B?)"q,(s), where g;(s) has no factor of 
(s — a)? + B?. Then a linear combination of functions in B, has the form f,(t) + 
fot), where fi (t) = cye* cos Bt +++++Cm—\t" !e cos Bt +doge™ sin Bt +++++ 
d—\t—'e* sin Bt is a linear combination of functions in Bos—ay2+pyn and f2(t) is 
a linear combination of functions in B,,. Suppose 


Ait) + fat) = 0. 


By Lemma 4 f/f; is identically zero, and by Lemma 6 the coefficients co,... , Cm—1 
and do,..., dm—1 are all zero. It follows that f2 = 0. By induction, the coefficients 
of the functions in B,, that make up /f2 are all zero. If follows that B, is linearly 
independent. oO 


A.4 The Matrix Exponential 


In this section, we verify some properties of the matrix exponential that have been 
used in Chap. 9. 
First, we argue that the matrix exponential 


“4 AZ AD A" 

Sere gi ae teal 2 
converges absolutely for all n x n matrices A. By this we mean that each 
entry of e4 converges absolutely. For convenience, let E = e4. Leta = 
max {|Ai.;| :l<i,jj< n}. If a = 0, then A = O and the series that defines e4 
reduces to J, the n x n identity. We will thus assume a > 0. Consider the (7, 7) 
entry of A?. We have 


(4)..3| = 


> Ait ALj 
[=1 


A.5 The Cayley—Hamilton Theorem 733 


In a similar way, the (i, j) entry of A? satisfies 


\(49).,;| = 


is Ai(A’)),j 
i=1 


< |Aii| |(A7),,,| 
1=1 


By induction, we have 
|(A*)ij| <n® lak, 


It follows from this estimate that 


(A); (A): _ 


|Eij| = \Dig + Aig + 


2! 3! 
(Any (A3);,; 
< 6; +|(Aij| + | ay i + | rT se 
naz na nia‘ 
2igtad to 
CO k-1 
nila 
k=l 
1 — (na) 
<1 1] an 
< +52 kl 2 


It follows now that the series for E;,; converges absolutely. 

If we replace A by Af, we get that each entry of e4’ is an absolutely convergent 
power series in ¢ with infinite radius of convergence. Furthermore, the last inequality 
above shows that the (i, 7) entry of e4” is bounded by 1 + dean and hence of 
exponential type. 


A.5 The Cayley—Hamilton Theorem 


Theorem 1 (Cayley-Hamilton). Let A be ann x n matrix and c4(s) its charac- 
teristic polynomial. Then 


CA (A) = 0. 
The following lemma will be helpful for the proof. 
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Lemma 2. Let j be a nonnegative integer and let a € C. Then 

D! (te) |=0 = Dit! | pac. 
Proof. The derivative formula D! (ye*’) = (o ay y) e” implies 


D! (te)|:<0 = (D + a)'t/)|:=0 
1 


»e (;) a" (Dk! )|.=0 


II 


k=0 
0 ifl<j 
=jasi 
d-7! if 1 > j 
= D!t! pag. oO 


Proof (of Cayley-Hamilton Theorem). Let ca(s) be the characteristic polynomial 
of A. Suppose A1,--- , Am are the roots of c4 with corresponding multiplicities 
T1,°°* ,%m. Then 


Bo, = {tle** : j = Dine =k = 1,540.59) 


is the standard basis for €,,. As in Fulmer’s method, Sect. 9.4, we may assume that 
there aren x n matrices Mjx, 7 =0,....17% — 1,k =1,...,m, so that 


m rr-l 
et! = > 72 the’ Mj x. 


k=1 j=0 


Differentiating both sides / times and evaluating at t = 0 gives 


m rr-l m rel 
A! = > ~~ D! (t/e*) |, 0M jx = > > Dit! |=a, Mix. 
k=1 j=0 k=1 j=0 


with the second equality coming from Lemma 2. Now let p(s) = co + c18 +++: + 
tg = ae cs! be any polynomial. Then 


N 
p(A) = ocr A! 
i=0 


m rre-l 


N 
= VY Yd aD! tran, Mix 


1=0 k=1 j=0 
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m re-l 
=)°) D (do«'] lr=a, Mj x 


k=1 j=0 


m rre-l 


= VY) PP An Mix. (1) 


k=1 j=0 


For the characteristic polynomial, we have c4(s) = Ile- 1(s — Ax)", and hence, 
cD (Ag) = 0 forall 7 = 0,...,7, —landk = 1,...m. Now let p(s) = c4(s) in 
Equation (1) to get 


m rr-1 


ca(A) = > cP Ar) Mix = 0. 


k=1 j=0 


Appendix B 
Selected Answers 


Section 1.1 


1. P’=kP 


3. A(t) =AVSh(t) 


5. order: 2; Standard form: y” = 13/y’. 
7. order: 2; Standard form: y” = —(3y + ty’)/t?. 


9. order: 4; standard form: y? = \/(1 — (y")4)/t . 


11. order: 3; standard form: y”” = 2y” — 3y’+ y. 


13. y1, yo, and y3 
15. y1, yo, and y4 


17. yi, yo, and y4 


19. 
y(t) = 3ce* 
3y + 12 = 3(ce*® — 4) + 12 = 3ce* — 12 + 12 = 3ce™. 
Note that y(t) is defined for all t € R. 
21. 
t 
YO= |G =a 


W.A. Adkins and M.G. Davidson, Ordinary Differential Equations, 
Undergraduate Texts in Mathematics, DOI 10.1007/978-1-4614-3618-8, 
© Springer Science+Business Media New York 2012 
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I. bese) ce’ 


2 = _ = 
yi) — yt) = (l—ce)2 1—cel = (1 — ce’)? = (1 —ce’)?" 


If c < 0, then the denominator 1 — ce’ > 0 and y(t) has domain R. If c > 0, 
then 1—ce’ = Oift = In 1 = —Inc. Thus, y(f) is defined either on the interval 
(—oo, — Inc) or (—Inc, ov). 


23. 


25. 


/ oh es eS ae) ee eae 1 
sae Co et pacar 


y= 


CD 


The denominator of y(t) is O when ¢ = c. Thus, the two intervals where y(t) is 
defined are (—oo, c) and (c, 00). 


27. yt) = S—tt+e. 

29. y(t) =t+In|t| +c 

31. y(t) = —4 sin 3 +ct+co 
33. y(t) = 3e' + 3t-—3 

35. y(t) = —18(¢ +1)! 


37. y(t) =—-te* —e™. 
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Section 1.2 


“++ +4 


VVANN+HZ7/71 
VVNNNtZ/7 1 
VVNNNFtZZ/7 1 
VVNNtZS/7/ 1 


+A 


VVNNtZZ/7/ 1 
VAVNNNFZ/7 1 
VANNFHZ/7 1 
VVNNNFZ/7 1 


4 


3 


2 


1 


0 


zt 


1 


2 


3 


4 


=5 


-5 -4 -3 -2 -1 


y(y +f) 


y= 


LNA 


!/—-\ 


V\V\NN-7// 71 


I! ISIfr-NNX\N 


| 


1 


1 


4 


=5 


-5 -4 -3 -2 -1 


0 


-5 -4 -3 -2 -1 
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ww 
~~ SSN NNN 
nN 
SNS NNN 
SSN NNNAN 
SA SRR NNN 
nS NS 
NN NNN SNS 
NNNNNN WAY SONY 
VVNNAVAAYN \; i 
Ceecreer- a POV VN. ii LNA 
OPI A, SEM ie A he rf | ey Aad 
ed il 407 
SAAS SASAYI TI aan 
COSCO see 
aan aa se oe 
aa aaa --- 
oS aaa aa --- 
aa Wd ---- 
ae) ee 
ae, ne 


3. Not separable 
7. Not separable 


1. Separable 


15. y=-t+(Qn4+1)r,neZ 
5. Separable 


17. 2yy’ —2t —3t? =0 
Section 1.3 


ll. y=0 
13. y=41 
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9. 


11. 


13. 


15. 


17. 


19. 


21. 


23% 


25. 


27. 


29. 
31. 


33: 


35. 


37. 


39. 


41. 


43. 


45. 


47. 


Separable 
t?(1 — y*) = ¢, c areal constant 

5 _ 542 
y? = 5t° + 10t +c, c areal constant 
y = 1-c cost, c any real constant 

— 4ce* _ 
YS ge CA real number, and y = 4 


y = tan(t +c), c areal constant 


In(y + 1)? — y = tan !t +c, c areal constant, and y = —1 


y= me c real constant 


yS0 
y=4er 
y=2Vuv4+1 


y(t) = tan(—+ + 1 + 4), (a, b) = (6/(6 + 5x7), 6/(6—7)). 


x 212 million years old 

~ 64 min 

t © 8.2 min and T(20) ~ 67.7° 
~ 205.5° 

602 

~ 3.15 years 

3857 


1, 400 


Section 1.4 


TA 
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— sin(t?) ; 
Toys Sets. 
9. y = 4sin4t — 3cos4t + ce* 
ll. c=? 4+14+ce 


13. y=1l—e75™ 


19. y= (t +c)sect 

21. y=t"e’ +t" 

23. y= tr? 213 

25. y(t) = ++ (4a—2)0? 


27. y = (0-1) - 4 (10 _ ty", for 0 < t < 10. After 10 min, there is no salt in 
the tank. 


29. (a) 10 min, (b) © 533.33 g 


31.(a) Differential equation: P’(t) + (r/V) P(t) = rc. If Po denotes the initial 
amount of pollutant in the lake, then P(t) = Ve + (Po — Ve)e~“/"". The 
limiting concentration is c. 

(b) ti2 = (V/r)1n2; tio = (V/r) In 10 
(c) Lake Erie: t1/2 = 1.82 years, t1/19 = 6.05 years, Lake Ontario: t1/2 = 5.43 
years, t1/19 = 18.06 years 


33. yo(t) = 10(5 4 t) 2 some r) fe ase 


Section 1.5 


1. y = ¢tan(In |t| + 2/4) 
3. VS 2t 
5. y=ttV1+kt,k eR 


7. y =tsin(n|t| +c) and y = +t 


9 aes! 
a lec 
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11. 


13. 


15. 


17. 


19. 


21. 


23. 
25. 


1 
y = +——— -. andy = 0 
v1+ ce” 
y : d 0 
= and y = 0. 
-5+ev1-?? 
y=-vV1+3e° 


y= and y = 0 


a 
—2y + 1n|2t-—2y|=c,ce Randy =t 
y-tanl(t+y)=c,ceR 
y=tvke —t,k eR 


saat 
y = el—-ltce 6c ER 


Section 1.6 


.P+ty=c 

. Not Exact 

. Not Exact 
.Go-?’—-2t4 =c 


_ yt =4ty +e 


Section 1.7 


1. 


3. 


y(t) =14 f/ uy(u) du 


yO) = 1+ fp OO a 


744 


5. 
yo(t) = 1 
yi@ = tte 
y2(t) = gt a ae i 
us es) ae ig i 
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t2 2 5 2 6p 18 rau 
7. nt) = 3921) = —< t+ oa 3) = ; 
WO = F3W2O =F + 55: BO = 5 + 35 + Teo + Ga00 
9, 
yo(t) = 0 
a 
Yi 
t’ 
A =6- 
ya(t) + 733 
th 
a ee 
Yt) = E+ Tea ae 
31 
ya(t) =t 


v 31-152. 74. 38 
83 


ES 
ys(t) =" + Ge ai3 gt. 78 316 


11. Not guaranteed unique 


13. Unique solution 


15. 
yo(t) = 1 
yi(t) =1+at 
a*t? 
y(t) = ec ae a 
er ar 


)Stsep 
y3(t) a a leery 
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azt2 


t a”t” 
yn(t) = tat + +e 


n\ - 
y(t) = limy—oo Yn (t) = e“; it is a solution; there are no other solutions. 
17. Yes 
19. 1. y(t) =t+ct?. 
2. Every solution satisfies y(0) = 0. There is no contradiction to Theorem 5 
since, in standard form, the equation is y’ = “y —l1= F(t, y) and F(t, y) 


is not continuous for t = 0. 


21. No 


Section 2.1 


1. Y(s) = = and y(t) = 2e* 


3. Y(s) = GH? and y(t) = te” 


ca 


5. Y(s) = a + + and y(t) =e % +e! 


qe Y(s) = 382E3. a 3(s+1) _ ; 


43st2 — GENG+) ~ 5 and y(t) = 3e7%4 


2 


9. Y(s) = a and y(t) = = sin 5¢ + cos 5¢ 
11. Y(s) = a and y(t) =e“ 


13. Y(s) = 


1 1 os = —2t 1,2,—2t 
Gti + GED = op 7 reo and y(t) = te" + 5t°e 


Section 2.2 


Compute the Laplace transform of each function given below directly from the 
integral definition given in (1). 


Ieee 
s2 os 
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11. 


13. 


15. 


17. 


19. 


21. 


23. 


25: 


27. 


29. 


31. 


33: 
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s—2 

2 5 4 
BS sr og 

1 a 7 
S+3 (s+ 4)? 
s+2 

s?+4 

2 

(s + 4)3 

Ee 2 4 1 
se (s—2)? 5-4 
24 

(s + 4)° 

1 

(s —3) 


1257 — 16 

(s? + 4)3 
2s 2 

es gas 


In(s + 6) — In6 
s 
2b? 
s(s? + 4b?) 


1 ( a—b i a+b 
2\s?+(a-b)  s*4+ (a+b) 
b 
yom he 
b 
eo Be 
(a) Show that (1) = 1. 
(b) Show that I” satisfies the recursion formula (6 + 1) = BI'(B). 


(Hint: Integrate by parts.) 
(c) Show that '(n + 1) = n! when z is a nonnegative integer. 
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Section 2.3 


The s — 1 -chain 


5s + 10 3 
(s — 1)(s + 4) s—l 
2 
a 


The s — 5 -chain 
1 1/7 
3. "(ee D\e— 5) | <G—5) 
-1/7 
(s + 2) 
The s — 1 -chain 
3s+1 2 
>: (s — 1)(s? + 1) s-1 
—2s+1 
s?+1 


The s + 3 -chain 


s+s—3 3 
(s + 3)3 (s + 3)3 
s—2 —5 
(s +3) (s +3) 
1 1 
s+3 s+3 
0 
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11. 


13. 


15. 


M7 


19. 


21. 


The s + 1 -chain 
Ss —l 
G2) (sly (s + 1)? 
s+4 3 
(s + 2)°(s + 1) s+l 
—35 —8 
(s + 2)? 
The s — 5 -chain 
1 —1 
(s — 5)>(s — 6) (s — 5)? 
1 —l 
(s — 5)*(s — 6) (s —5)4 
1 —l 
(s — 5)3(s — 6) (s — 5)3 
1 —l 
(s —5)?(s — 6) (s= 5)? 
1 —l 
(s — 5)(s — 6) s—5 
1 
s—6 
13/8 Wy 5/8 
s—-5 s+3 
23 f 37 
12(s—5) 12(s +7) 
25 = 9 
8(s—7) 8(s4+1) 
1 1 1 
GES) Sey =e 
7 


ore 
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3 5 


1 


eLap G@aae” 


s+3 


TAO 


95 1 ( 5 if 21 of 3 5 ) 
“54\5s—-5 (stl)? (s—5) stl 
—2 1 
oF. pote ree 
(s+2)? s+2 (s4+1)? stl 
29 12 4 —14 n 15 sp —16 4 1 
“(s—3)8  (s—3)? s-3 s-2 s-1 
2 5) 3 5 
31. + es 
Ga e=0 (s—3)2 s—3 
23: ¥(s) a cr = =a + = and y(t) = —3te'—e™ oF a 


35. Y(s) = 0+ 4 


P and y(t) = —30¢ + 24—26e7" + e* 


37. ¥(s)= & aie H+ G BG y= a =) — + and y(t) = 2 + 3e% — 3e! 
Section 2.4 
The s* + 1 -chain 
1 1 
(s2 + 1)?(s? + 2) (s2 + 1)? 
1. 
—1 —l 
(s? + 1)(s? + 2) (s2+ 1) 
1 
s*4+2 
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11. 


13. 


15. 


M7 


19. 
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The s* + 3 -chain 
85 + 857 12—4s 
(s+3)3(s? + 1) (s? + 3)3 
4(s— 1) 2—2s 
(s? + 3)?(s? + 1) (s? + 3)? 
2(s— 1) l-s 
(s? + 3)(s? + 1) 57 +3 
s-—1 
s?+1 


The s? + 25 + 2 -chain 


1 1 
(s? + 28 + 2)?(s? + 28 + 3)? (s2 + 2s + 2)? 
—(s* +25 + 4) —2 
(s2 + 25 + 2)(s2 + 25 + 3)? s2+2542 
2s* + 45+7 
(s? + 2s + 3)? 


1 3 ay as 
“10\s—-3  s?+1 


9s? ye st 1 
(s2+4)22 +1) (s2+4)2  s2?+4 s+] 
2 6— 2s 
s-3  (s—3)?+1 


—5s + 15 —s+3 ae 1 
(s?—454+ 8)? s*-—4s5+8 s-1 


stl 25 +2 stl 2s +2 
(s?+4s+6) s?+4s4+6 (87+ 4545)? 527+ 4545 


1 4s 1 io 
Y(s) = Gap + Wppoae? = rea and y() = 5 sin 2r 


3 8 te 8 T 
(s2+9)(s2+4) ~ 5 52+4 5 s2+9 


+ 


Y(s)= + and y(t) = $sin2r — 4 sin 3r 


FA 


B_ Selected Answers 751 


Section 2.5 

1. —5 

3. 3 — 20? 

5. 3cos2t 

7. —L1te~* + 2e% 

9. ce? —e-* 
11. mr + 3 p29 + 2te 

6 2 

13. te’ +e’ + te’ —e* 
15. 4te”’ — e*" + cos 2r — sin2t 
17. 3-6t +e% —4e™ 

19. 2e~ cos 2t — e~ sin 2t 
21. e*’ cost + 3e" sint 
23. e' cos 3t 
25. 2t sin 2t 
27. 2te~*' cost + (t —2)e~* sint 
29. 4te cost + (t—4)e™ sint 
31. _ ((3 — 4t?)e sin 2t — 6te' cos 21) 
33. z ((—23 + 3r)e* sint — 327e" cost) 
35. y(t) = cost — sint + 2(sint —t cost) = cost + sint — 2t cost 
37. Y(s) = a and y(t) =f sint — ft? cost 

(s? + 1)3 

Section 2.6 

1. By = {e*"} 
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1SS) 
B® 
ll 
ps 
° 
= 
“~~ 


\o 
B&B 
ll 
fees SEES ieee” See a 
Ks 
LN 
= 
ey 
Ww 
“~~ 


~] 
B&B 
ll 
oO 
2 
°| 
se 
“—— 


e2tV3t @2- et) 
e3t/2 ie 3/2} 


15. B, = {cos(5t/2), sin(5t/2)} 


17. By = {e' cos 2t, e' sin 2t} 


IS Beste ye re bet 


{ 
c= 1eo" cost,e~! sint, te~”! cost, te" sin ¢} 
{ 


BS & 


cost, sint, tcost, tsint, t2 cost, tf? sint, to cost, f° sin t} 


1. Yes 


3. Yes 


, cost, sint} 
te’, t7e eo , te 7! \ 


B, = te’, 
By = {e', 
li Be = fe" te ~, t7e-*, cos2t, sin 2t, t cos2tr, t sin 2r} 
Beale tee te ee 

By ={ 


e*, tew**, e3’ cos 2t, e7*! sin 2r, te~*’ cos 2t, te~* sin 2} 
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23. By = {e"; te, t7e*, e' cos 3t, e' sin 3t, te’ cos 3f, te sin 31} 


25::Bg = fee: e’, te’} 


27. By = {eos V3t, sin/3t, cos /2t, sin v21 


Section 2.8 
i 
1s 
6 
3. 3(1 — cost) 


5. 74 (2e* — 2 cos 2r — 3 sin 2) 

7. aig (18? — 6t —6-e“) 

9. -(e% —e“) 

11. orp (be™ —bcosbt —asinbt) 


b sin at—a sin bt : 
age if b x a 


13.4 
ut cos at ifb=a 
qsinas—pein bi if D # a 
15. 
x(atcosat+sinat) ifb=a 
4 


1 
23. rice + e*) 


1 
25. =tsint 
2 
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21. 


29. 


31. 


33; 


35. 


37. 


1 
mo —2cos2t — 3 sin 2t) 


[ g(x) cos V2(t — x) dx 
0 
t—sint 


1 
rie — 6t + 91? — 2e7**) 


1 
— (2 — 3¢ sin 3t — 2 cos3t) 
162 


Section 3.1 


11. 


13. 


15. 
17. 


19. 


. Yes; D?(y) = —2 + cost, q(s) = s?, nonhomogeneous 


(a) 6e! 
(b) 0 
(c) sint —3cost 


(a) 0 
(b) 0 
(c) 1 
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. Yes; (D* —7D + 10)(y) = 0, q(s) = s? — 7s + 10, homogeneous 


y(t) =cos2t+ ce! + coe where c}, C> are arbitrary constants. 


y(t) = cos2t +e! —e* 


L(e") = (ar? + br + c)e™ 
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Section 3.2 


1. Linearly independent 
3. Linearly dependent 
5. Linearly dependent 
7. Linearly independent 
9. Linearly independent 
11. Linearly independent 
13. Linearly independent 
15. ¢ 
17. 10t7? 
19, eet (rss — 19) =F) 
21. 12 
23. cy = —2/5,0¢. = 1 


25: a, = 3,a. =3 


Section 3.3 


1. y(t) = cye** + ee 

3. y(t) = cre" + ene 

5. y(t) =cye" + ete * 

7. y(t) = ce cos 2t + cre sin 2t 
9. y(t) =cjye" +oe* 

11. y(t) = cye™™ + cote 


13, y= 


15. y = te™ 
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17. g(s) = s? + 4s — 21, w(e*, e~”) = -10e-", K = —10. 


19. g(s) = s? —6s + 9, w(e*, te) =e", K = 1. 


21. q(s) = s? —25 +5, w(e' cos 2, e! sin2t) = 2e%, K = 2. 


Section 3.4 


25. 


. Yp(t) = aye* 


yp(t) = ayte” 


Yp(t) = a, cos 5t + az sin 5t 


yp(t) = ajt cos2t + aot sin 2t 


yp(t) = aye cost + aye’ sint 

y = te 4 ce + ene 
— 1,2,-+ t t 

y= xf e’' +ce + cote 

y= se + ce cost + ce sint 

y=? —-2+cqe +7 

y = te + ce + cote”, 

y= te2! — 2¢7! 4 ce! Bis cote! 

y = fte™ sin(2t) + cye* cos(2t) + coe~* sin(2r) 
23 =) 338 10 ,6t 135 ,—-t 

MS gage hae cheek 


27. y = 2e% —2cost — 4sint 


Section 3.5 
lL. y= pe" +. cye* + ce! 
3. y= te + ce 4+ coe * 


5. y= —te* + cye* + coe *# 
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7. y= te — 2¢7 + ce + ete * 
9. y = —317e*! cos 3t + te* sin 3t + ce“ cos 3t + coe sin 3t 


ll. y= i sint + ce! + cote 


Section 3.6 


1. k = 32 lbs/ft 

3. k = 490 N/m 

5. = 8 lbs s/ft 

7. 400 Ibs 

9. 6y” + 20y = 0, y(0)=.1, yO) =0;y = 7 608 oe undamped free or 
simple harmonic motion; A = 1/10, B = 10/3, and ¢ = 0 


11. Sy” + 2y' + 32y = 0, yO) = 1, yO) = 1; y = e* cos V60r + 


Tae sin /60t = ,/ Be! cos(/60t + ¢), where ¢ = arctan 60/20 
.3695 ; underdamped free motion. 


ru 


II 


13. y’ + %y = 0, yO) = 0, yO) = 2/3 y = sin V96r 


Ya cos (v 96t — 4); undamped free or simple harmonic motion and crosses 


equilibrium. 
Section 3.7 
1. q(t) = —ZRe™ cos 20t — Fee sin 20 + 4 and I(t) = e~?" cos(20t — 
m/2) 


3. g(t) = $e!" + Tre!” — 4 cos St + 2 sin 5¢ and I(t) = —e!" — 70te 1% + 
4 sin 5t + 3cos5t 


5. q(t) = (cos 25t — cos 100f); the capacitor will not overcharge. 
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Section 4.1 


1. Yes; (D* — 3D)y = e’, order 3, g(s) = s? — 3s, nonhomogeneous 
3. No 
5. (a) 0 

(b) 0 

(c) 0 


7. (a) 10e* 
(b) O 
(c) 0 


9. y(t) =te* t+ cje*% + oe +06 


11. y(t) = te# + e% + 20-7 - 1 


Section 4.2 


1. y(t) =cye t+ ce7 2! cos ey + c3e72! sin wey 
3. y(t) =cie’ + coe! +3 8int + cacost 

5. y(t) = ce! + cpe! + c3e7" + eye! 

7. y(t) =cje~ + cr cos 5t + ¢3 sin 5t 

9. y(t) = cye’ + coe~* 4 c3te~*! + cgt?2e7! 


11. y =e’ —3e + cost + 2sint 


Section 4.3 
1. y=cte" 
3, y= ce” 


5. y= Ste! + ce + ce +63 
y= pte"! + ce’ + oe! + c3e7/ + cue 


9 y= ste! tcel+ ome +03 
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ll. y= c +c, +c. cos 2t + c3 sin 2t 
13. y = —t(sint + cost) + cje’ + cy cost + co sint 
Section 4.4 
1. yi(t) = —4e?’ + 6e and y2(t) = —4e?/ + 3e¥ 
3. y,(t) = cos 2t¢ — sin 2t and y2(t) = —cos2t + sin 2t 
5. yi(t) = —20e + 40e’ — 20e” and y2(t) = —6e* + 20e’ — 12e7 
7. yi(t) = 3e — 3 cos 3t + sin 3t and yo(t) = 3e + 3cos 3¢ + 3 sin 3t 
9. y(t) = cost+sint+2cos2t+sin 2t and y2(t) = 2cost+2sint—2 cos 2t— 
sin 2t 
13. yy (t) = 2e' cos 2t + 2e’ sin 2t and y2(t) = —2e’ cos 2t + 2e' sin 2t 
15. y,(t) = 20— 19 cost —2sint and y2(t) = 8 — 8cost + 3 sint 
Section 4.5 
1. y(t) = 10e~*', asymptotically stable 
3. y(t) =e’ + e*, unstable 
5. y(t) = e~* sin(t), stable 
7. y(t) =e * + 4te~*’, stable 
9. y(t) = e'(sin(t) + cos(t)), unstable 
11. y(t) =e, marginally stable 
13. y(t) =e" 
15. y(t) = 4(e% —e) 
17. y(t) = 1—cos(t) 
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Section 5.1 


1. Not linear 
3. Yes, nonhomogeneous, yes 
5. Yes, nonhomogeneous, no 
7. Yes, nonhomogeneous, no 
9. Not linear 


11. Yes, homogeneous, no 


13. 1. L(4) =0 
2. L(l) =-1 
3. L(t) =0 


4. L(t") = (r2—1)t" 
15. C=5 
17. (3)a. y(t) =e! -e' +21 
(3)b. yt) =e'+ (Oe +()t=e' +t 
(3)c. y(t) =e! +-e! + 3t 
(3)d. y(t) =e' + (a—le’+ (b-—a42)t 
19. (—o0, 0) 
21. (0,2) 
23. (3, co) 


25. The initial condition occurs at f = 0 which is precisely where a7(t) = t? has a 
zero. Theorem 6 does not apply. 


27. The assumptions say that yi(to) = ya(to) and yj (to) = y5(to). Both y; and 
yz therefore satisfies the same initial conditions. By the uniqueness part of 
Theorem 6 yj = yo. 


Section 5.2 


1. Dependent; 2¢ and 5¢ are multiples of each other. 
3. Independent 


5. Independent 
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11. 1. Suppose at? + b [¢3| = 0 on (—oo, oo). Then fort = 1 andt = —1 we get 
a+b=0 
-a+b=0. 
These equations imply a = b = 0. So y, and yz are linearly independent. 
3 8 6if t<0 
2. Observe that yj(t) = 32? and y5(t) = ; Ift < 0, 
317 if > 0. 
Pe —1 
then w(y1, y2)(t) = det & 2) = 0. If t > 0, then wy, y2)(t) = 
sae 
det ee ia) = 0. It follows that the Wronskian is zero for all tf € 
(—oo, 00). 

3. The condition that the coefficient function a2(t) be nonzero in Theorem 2 
and Proposition 4 is essential. Here the coefficient function, t?, of y” is zero 
at t = 0, so Proposition 4 does not apply on (—oo, 00). The largest open 
intervals on which ¢* is nonzero are (—0o, 0) and (0, 00). On each of these 
intervals, y; and y2 are linearly dependent. 

4. Consider the cases t < 0 and t > 0. The verification is then straightforward. 

5. Again the condition that the coefficient function a2(t) be nonzero is essential. 
The uniqueness and existence theorem does not apply. 

Section 5.3 
1. The general solution is y(t) = cit + cot”. 
3. The general solution is y(t) = cyt} + ot Int. 
5. The general solution is y(t) = cyt? + cot? Int. 
7. y(t) = ct + cot Int 
9. The general solution is y(t) = cyt? + cot~. 
11. The general solution is y(t) = c;t? cos(3 Int) + cot? sin(3 Inf). 
13. y = 24/2 —¢¥/? Int 
15. No solution is possible. 
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Section 5.4 
S—a 
1. In( ) 
s—b 


s* + b? b a 
. sin | ——— ) — 2btan7! [ — ) + 2atan7! (— 
s n(5*5) an (2) atan (<) 


5. y=cye ' + c(t —1) 
qe yt) Se 
9. y(t) = c, (3 — 27) sint — 31 cost) 
e —1 
11. y(t) =Cc a 
oh tt 
ena), 
sint 1—cost 
15. y(t) =c) + C2 
t t 
Section 5.5 
1. y2(t) = ft? Int, and the general solution can be written y(t) = cit? + cot? Int. 
3. yo(t) = Vt lnt, and the general solution can be written y(t) = cy Vt +o + 
2/t Int. 
5. yo(t) = te’. The general solution can be written y(t) = cit + cote’. 
7. yo(t) = = cost”. The general solution can be written y(t) = c, sint? + 
7 cos t?. 
9. y(t) = —1 —t tant. The general solution can be written y(t) = c; tant + 
ceo(1 + ¢ tant). 
11. y2(t) = —sect. The general solution can be written y(t) = c tant + co sect. 
13. yo = -1—- S. The general solution can be written y(t) = aes + 


C2 (1 + ea) 


B 
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15. yo(t) = 4¢ + {(. — 27) In (+4), and the general solution can be written 


1 1 1+t 
=c(1—?? =t + —(1—17)In{ ——)). 
y=ott +0 (4e+4a-m(144)) 


t 


Section 5.6 


. The general solution is y(t) = Ht cost + cj cost + c2 sint. 

. The general solution is y(t) = $e! + cye! cos 2 + ce! sin 2¢. 

. The general solution is y(t) = Se + cye’ + ce*". 

. The general solution is y(t) = ¢t Inte’ + cye’ + cote’. 

. The general solution is y(t) = e + cit + c2t?. 

. The general solution is y(t) = fIn*t + cyt + cot Int. 

. The general solution is y(t) = © tant +t+c; tant + cz sect. 


. The general solution is y(t) = t? + c; cost? + c sint?. 


- p(t) = if) * sinh at 


- Yplt) = Apf@ * (e" —e”) 


Section 6.1 


11. 


13 


. Graph (c) 
. Graph (e) 
. Graph (f) 
. Graph (h) 
. -22/3 

4 


. 11/2 
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15. 5 
17. A, B true. C false. 
19. A is true. B and C are false. 
21. A and B are true. C and D are false. 
23. A,B,C, D are all true. 
-l+e if0<t <2, 
25. y(t) = 4 1—2e' 7% + e! if2<t<4 
e+ 2e 2 +e if4<t <oo. 
0 if0<t<1l, 
—t+e! ifl<t <2, 
ie aeaieas 
t—2-2e ?@+e! if2<t <3 
3 —2e 2 +e! if3 <t<oco. 
—t '_et if0<¢t <1, 
29. y(t) = +e —e wO<t< 
e—e!—e7! 1<t<oo. 
Section 6.2 
y 
3 ——aA 
2 | WK 
| 
1 | 
1,0 ot 
0123 45 67 8 
y 
2 
1 
3.9 t 
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x 
8 + 
6+ 
4+ 
7 
7 
va Pa 
0 1 2 3 
y 
1 
0 t 
Tu 20 3m 
—l 


9. (a) (t 2), 2 (0); (b) (t — h(t — 2); (@) 2/2 
1. (+ Dee NO (C+ HAE - Ie (5 +2). 


8 16 


2 
13. (a) 17 44,00)(t); (b) t2h(t — 4); (c) e~** (= +5 ~), 


2 
15. (a) (¢ — 4) xp, coy(); (b) (t — 4)°A — 2); CE (= Pie 


17. (a) e 114,00) (t); (b) hit — 4); (c) e 46-) — U 


19. (a) te’ x14, o0)(t); (b) te’h(t — 4); 


i 4 
—4(s—1) — 
oe (Gay ts): 


21. (a) ty[0,1) (0) + (2 — 1) XI1,.00) (4); (b) t + (2 — 2H)A(t — 1); 


1 2e* 
(c) io) = we 


23. (a) t? x0,2)(t) + 4xp3(t) + (7-1) 7B, (1); 
(b) t7 + (4—27)h(t —2) + 3 —2)h(t — 3); 


2 2 4 er 
—2s 
Oa (4+5)- ms 
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25;:(a) Yo =) yada Oe) t=) hE a); 

ere 

27. (a) Drko(2n + 1 —£) xpn2n42)(t); (©) -—@ + 1) + 2 2g AC — 2n); 
(c) -5 . sl a5: 


0 if0 <t <3, 


29. (t —3)h(t -—3) = 
dace ) ee ift > 3. 


31. h(t — zz) sin(t — 2) 
-|° on if0<t <x, 


sin(t{—a) iff>a —sint ifft>a. 


0 if0<t<qz, 
33. se 0”) sin2(t —m)h(t —1) = ies . 
se") sin2t ift > 7. 


0 if0<t <2 
35. 4h(t — 2) sin2(¢ — 2) = Pepe hoes 
$sin2(t—2) ift > 2. 
37. h(t — 4) (20-204) — e-t-4)) 
2 i if0<1 <4, 


2e-7Y) —e DY ft > 4. 


t if0<t <5, 


39. t-(¢—5)h(t —5) = 
Pea ne : ift > 5. 


Al. h(t —w)e3"—) (2.cos 2(t — x) — 3 sin2(t — 7) 


-\° if0<t<z, 


e-) (2cos2¢—3sin2r) ift > 7. 


Section 6.3 


' if 0<t<1 
ly= 


—2(1-e%-) if 1<t<oo 
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0 if 0O<t<2 
3. y= 93 (e°' — 1) i er 23 
$ (0-9) —e9) if 3<t < 00 
‘ 6e* — 4e! if 0O<t<1 
y= 
6e" —e3-—3e if l<t<o 
0 if 0<t <3 
TPS 45 . 
q(l-—cos3tt— 3) af 3% < 00 
0 if O<t<l 
9. y= 4 1—3e720-D 4 2673 E-D if 1<t<3 
3e7 20-3) — 3e720—-D — 2e73U-3) 4 De“ if 3 < t < CO 
te! ifO0<t <3 
ll. y= 
l+te’—(t-2)e"9 if 3<t<o 
4—4ex if 0<t <3 
13. y(t) = . = —(-3) : ae 
20 —4e2 — 16e7 2 if ¢ > 3. 
10 — 8e7 3/10 if 0O<t<2 
15. y(t) = 4 10e3/-2)/10 _. ge 31/10 if2<t<4 
10 — 8e734/19 + 10e~36-2)/19 _ 10e 36-90 if 4<t < 00 
Section 6.4 
1 0 if0<t<1l 
y= 
e20-)  ifl<t<co 
, Qe" if0<1<4 
LoS 
Qe? +e“) if4<t <0 


3: 


ea if0<t<z, 
a 


sin 2t ift > az. 


767 


768 


e! if 0<t<2 


ef + e-t-2) _ eI“), if 2<t < 00. 


—e 2! if 0<t<1 


pe VS esate Slee VA. ates 60 


24 — 24e74! if 0<t <3 


a4 4ei-3) if 3<t <0 


ll. y= 
eee 
e if0<t<2 
et +e") if 2<t<4 
13. y= 


et + el) 4 e+) if 4<t<6 
et + eT) 4 eH) 4 (9 if 6 <t <0 


ne if 0<t<4 


15. y= lg ss (t = Aye 2t—-4) if 4<t<oo 
10 = 


sint if 0O<t<az 
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and y(6)=1.156 lbs. 


0 if 7 <t<27 
sint if 2n<t<3z 
17, y= 
0 if 3a <t <47 
sin ¢t if 4a <t <5n 
0 if 5a <t<o. 
The graph is given below. 
1 
0 
4 2n 3x An 5x 6x 
—l 
At t = O, the hammer imparts a velocity to the system causing harmonic 


motion. At ¢ = mz, the hammer strikes in precisely the right way to stop the 


motion. Then at t = 277, the process repeats. 


19. y= yor + ke al-9) 
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Section 6.5 
e —1 if 0<t< 1 
TS of PEE) Ss  egae 
e’—e if l1<t<o@ 
t if 0<t<2 
5. fe¥g=4j-t+4 if 2<t<4 
0 if 4<t<o 


sint if 0<t<az 
fees] 


0 if t7<t<o 


2e%" if 0<t< oo 


9. S(t) =e, y= 
2e%¥ + (2% _-1) if 1<t<oo 


—2e-8t if O<t <3 
11. §(t) =e, y = 4 -2e-8 4 F (1 — 8-9) if S715 


=2e# ELEM EMD) if 5 Zt <00 


nya gfe if O0<t<2z 


0 if 27 <t <oo 
23. y = 2e' —Tte’ 


25. y=5—A4cost 


Section 6.6 


1. ((t)1)? 

3. Lis? 

5. (t)2 + lth 

7. L(t) = FS 
9. LL F(t)2p)} = tert 


I. Llp} = zeheH 
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= J—e725 1 
13. Vi= J—e—26-FD 5 


=| J—e—4(s—-2) _ 2t 


Section 6.7 
1. Y 
=2t 10es" 4 (/2h 20 
y(t) = 10—10e > + 10swo(t) — z (1 +e8(- les :) 
1+e5 
The amount of salt fluctuates from 13.10 pounds to 16.90 pounds in the long 


term. 


Li 
3. y(t) = 5e72! _ and the salt fluctuation in the tank varies between 2.91 
and 7.91 pounds for large values of f. 


5. The mathematical model is 
y’ =ry —4080((t)1), yO) = 3000, 
where r = 4 In = The solution to the model is 


‘ et — el (th -—~+) 
y(t) = 3000e" — 49 
—eTl 


and at the beginning of 60 months, there are y(60) ~ 3477 alligators. 


Section 6.8 
1. 
y(t) = 2(2swi(t) — (—1)"l'(cos(t); —a@ sin(t)1)) 
—2 (cost +asint)), 
where « = —%"¥2_ Motion is nonperiodic. 


1+cos /2 
3. yD=4 (2 sw2(t) — cost ((—1)e/7h + 1)), the motion is periodic. 


m2 


5. y(t) = = (sw, (t) — [t], cos wt — cos wt), with resonance. 


B 


11. 
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y(t) = sint + sin(t), 
(1+ (-1)"/7!) sint. 


II 


Motion is periodic. 


y(t) = sint + y cost + sin(t); — y cos(t),, 


—sinl 


where y = at 


The motion is nonperiodic. 


y(t) = 2(sint)(1 + [t/27]]). 


Resonance occurs. 


Section 7.1 


11. 


13. 


15. 


17. 


19. 


21 


Co 

(=1)"12" 
Sy Qn+l! 
n=0 


p2nti 


CO 
XI" n-+1 


tant=14+ 44204 217+... 


ae = 2 1s ee Oe 
esnt=t+t* + 3 396° + 


. Ud -tye™ 


771 
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2 
25. f(t)=—5 + G*in() 


27. The binomial theorem: (a + b)" = )7y<o (j)a*kb"™ 


Section 7.2 


oo p2n iS p2nt+i + 
1. y(t) =co | Gay +1 ye Gath = co cosht + c; sinht 
n=0 n=0 


k2"4 2n 2n+1y 2n+1 


Co 
3. y(t) =co 2 (-1" a +c pug je onthe = © coskt +c, sinkt 
n=0 


p2n+i 


5. y(t) = col — 12) 1 2 ontnoy = col — 7) — 01 (§ + FtIn( 154) 


7. y(t) = co (1+ Deo r) + ct = cole’ —t)+ cit 


9. y(t) = oo(1—307) Fa(t-—& 


Section 7.3 


1. —1 and 1 are regular singular points. 
3. There are no singular points. 
5. 0 is a regular singular point. 


7. q(s) = s(s + 1). The exponents of singularity are 0 and —1. Theorem 2 
guarantees one Frobenius solution but there could be two. 


9. q(s) = s*. The exponent of singularity is 0 with multiplicity 2. Theorem 2 
guarantees that there is one and only one Frobenius solution. 


_yym 2m+3 r 
15. y(t) = Dano = (sint — tcost) and y(t) = 


—yyn+l1 _4)7-2m , 
yaw Sa = (tsint + cost) 
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17. vit) = Vey At" t! = te! and y(t) = (re! Int—t yee, a), where s,, = 
1+h444e4, 

19. yi(@) = Cneo “Gage = (SRK + 52) and yf) = 1A - ) = 
I (2+) 

2\G 
3 —]yrzen 

21. yi(t) = #2 and yo(t) = #2 Int + (-1 +21-F +r, He ) 

23. The complex Frobenius series is y(t) = (t' + (55) t'*'): the real and 
imaginary parts are y|(t) = —3cosIn¢t — 4sinIn¢ + 5fcosIn¢ and y(t) = 
—3sinInt + 4cosInt + 5¢ sin Int. 

25. The complex Frobenius solution is y(t) = (72 aan = tie’; the real and 
imaginary parts are y;(t) = e’ cosIn¢ and y2(t) = e’ sinInt. 

Section 7.4 

Section 8.1 

1 1 1-3 2-8 
1B+C=]|-1 7], B-C=] 5-1], and2B—3C =| 13-6 
0 3 —2 1 -5 1 
4 3-1 7 
3. A(B+C)=AB+AC = , (B+C)A=)}3 125 
1 13 
5 012 
6 4-1-8 
5. AB=|]0 2-8 2 
2-1 9-5 
8 0 
4—5 
7. CA= 
. 8 14 
10 11 
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8 9 —48 
9. ABC = 40 —48 
—23 40 


0 0 1 
15. | 3-5-1 
0 0 5 


01 00 
17. (a) Choose, for example, A = k 5 and B = F Al 


(b) (A+ B)? = A? +2AB + B? precisely when AB = BA. 


ln 
19. B? = 
mal tfi 


21. (a) Of Ans in ; the two rows of A are switched. (b) he A= 
10 VI 01 


Cc ; ; : 
le EVs ; to the first row is added c times the second row while the second 


v2 
row is unchanged. (c) To the second row is added c times the first row while 
the first row is unchanged. (d) The first row is multiplied by a while the second 
row is unchanged. (e) The second row is multiplied by a while the first row is 


unchanged. 
Section 8.2 
14 3 p 2 14 3/2 
11-1 4 11-1/4 
1 A= eT nr icccmmel Cs ,b= 1 |? 2nd [Alb] = 50 11I' 
01-1 : 6 0 1-1/6 
xX, - x34+4x4+ 3x5= 2 
5x1 + 3x. — 3x3 -— x4 —3x5= 1 
3x, — 2x. + 8x3 + 4x4 —3x5= 3 
—8x, + 2x2 + 2x4 + x5 = —4 
5. RREF 
0103 


7. m2(1/2)(A) = | 0013 
0000 
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9. t13(—3)(A) = 


21: 


29. 


| 


Y) 


if 


ae 


| 
| 
fe 
| 
| 
: 


100-11 —-8 
010 s Sr 
001 


12003 
00102 
00010 
00000 


102 


000 
000 


14003 
00101 


00013 


x 
y 


i 
ae 


14/3 
1/3 
9/5 


10103 
01341 
00000 


aCe 
o[2haer 


TIS 


716 


33% 


35; 
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1 1 
The equation | —1 | = a]1 |+65]-—1] has solutiona = 2 and b = 3. By 
4 2 0 


Proposition 7 | —1 |, is a solution. 


—7/2 —3/2 
If x; is the solution set for Ax = b;, then x; = 7/2),x. = 3/2], and 
23/9 2172 


Section 8.3 


1 


3. 


5. 


[3a] 


Not invertible 


Not invertible 


—6 5 13 
5—4-11 
-1 1 3 


299°39/2:=299: 13 
7-9/2 5-3 
—22 29/2 -17 10 
9) +6, FA 
0.06 it 
10 0 0 
O: wisi 
Py es 
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5 
13. x= 
= 
16 
I5.x=7| 11 
18 
19 
eee oe a! 
15 
—6 
19. (Aye = (A) 
21. F(6)"! = F(-60) 
Section 8.4 
1. 1 
3. 10 
5. —21 
7. 2 
9. 0 
s—3 1 
HH zis | ce oes 
(s — 1)? 3 s-1 
13. a 0 (s— 1) 0 
0 3(s — 1) (s — 1)? 
sts 4s+4 0 
1S). Saas |S Se es 0 
s—445+4574+4 
17. no inverse 
4-4 4 
19. £]-1 3-1 
=5:=1 +3 
2-98 9502 
21. 4/0 3-297 
0 0 6 


s=1 


s=-l1,A 


t2i 
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55 —95 44-171 
53, 1 | 50 —85 40 —150 
'5 | 70 —125 59 —216 

65 —115 52 —198 


Section 8.5 


1. The characteristic polynomial is c4(s) = (s—1)(s—2). The eigenvalues are thus 


Ss = 1,2. The eigenspaces are F; = Span Bl and Ey = Span il} : 


3. The characteristic polynomial is c4(s) = s? — 2s + 1 = (s — 1). The only 


eigenvalue is s = 1. The eigenspace is EF; = Span i . 


5. The characteristic polynomial is c4(s) = s* + 2s —3 = (s + 3)(s — 1). The 
eigenvalues are thus s = —3, 1. The eigenspaces are E_; = Span il} and 


n-omf 


7. The characteristic polynomial is c4(s) = s? + 2s + 10 = (s + 1)? + 3”. 


The eigenvalues are thus s = —1 + 3i. The eigenspaces are F_j43; = 
aff homes lh 
1 0 
9. The eigenvalues are s = -—2,3. E_» = Span 2), 1 , £3 = 
0 1 
1 
Span Ole, 


-1 
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0 
11. The eigenvalues are s = 0,2,3. Eo = NS(A) = Span 2|>, &o = 
1 
2 0 
Span ; | 2] 7, £3 = Span 1 
1 1 
13. We write c4(s) = (s — 2)((s — 2)? + 1) to see that the eigenvalues are 
2 —4+ 31 
§ = 2,2+i. Ey = Span 3) ¢, Eo4; = Span 44+ 2i , fyi = 
1 5 
—4—3i 
Span 4—2i 
5 
Section 9.2 
1. Nonlinear 
; sint 0 F : 
3, y= ee y; linear and homogeneous, but not constant coefficient. 


0001 


1000 

; 2001 ; ; 

53. y= y; linear, constant coefficient, homogeneous. 
0120 


11. y’ 


, fol 0 _ fo 
ee = le a Pee A HI 


15. y= 


II 


17. A(t) = 


1 
19. y(t) = 2t 


780 


e—e2 e@+e%-2 

23. tl, a) Oe, ited 
4 8 
a Be ie 


LoL 
97. : | 

dy td 

s3 s—2 


3! 2s 1 
29 st (s2+1)2 ad 


2-s s—3 3 
s> s2—6s+13 Ss 


1-1 
31. Ay|_| i 


33. [1 2¢ 317] 

e+e’ e—e? 
35. 

e—el ete? 
Section 9.3 


e 0 
1. e4 = nee 


a) pAb cosht sinht 
: sinht cosht 


cost sint 0 
7. ec! = |—sint cost 0 


0 Oc? 


s—2 —1 2 
9. (sf — A) 1 = pes ‘ey and e4! = E 
2 
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s+l 5 
2: 2 
11. @— A) = ee pie 


o_ 


s—3 
(s—1)2+1 (s—1)?+1 
andet = e’ cost + 2e! sint Se! sint 
> —e’ sint e' cost — 2e’ sint 
Lo. s+ 
sz ltt+ 
SiS: 1 1 At _ 
13. @f-A)"=]0 zx ande“’ = | g 1 t 
00 1 00 1 
cost sint 0 
15. e4’ = |] —sint cost 0 
0 Oc 
Section 9.4 
1. eft e+te -—te! 
te’ e' — te! 
Sle 1+ 2t t 
—4t 1—2t 
5 et = e’ cost + 3e’ sint —10e’ sint 
; e’ sint e' cost — 3e! sint 
5S dt (mee Men lle? 
, 4] —7Je + Je! 1le*! — 7e7?! 
Gels e”’ cos 3t + 8e! sin 3¢ 13e”! sin 3¢ 
: = —5e”' sin 3t e* cos 3t — 8e”' sin 3t 
ul G et te 2! 
HORS oe ent et 4 pe72t 
a : -l+e™ 
13. e4f = 0 
a 6 —1+2e7 
e’ + e' cost —e! sint e’ — e’ cost 
15. e4? = 5 2e' sint 2e’ cost —2e! sint 


e'—e’cost e‘sint e' +e! cost 
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—e' + 2cos2t —sin2t e’ —cos2t 
17. ce = 2sin2t cos2t —sin2t 
—2e' + 2cos2t —sin2t 2e’ — cos2t 


cost —tcost sint —tsint tcost t sint 
19. et? = —sint + ¢sint cost —fcost —tsint t cost 
, —tcost —tsint cost+ftcost sint +f sint 
t sint —tcost —sint —fsint cost +tcost 
Section 9.5 
e! 
1. y(t) = EA 
2t 2t 
—e’ + 2te 
3. y(t) = eal 
e! 
5 t)= 
y(t) Eel 
e’ —2te! 
d t)h= 
yf) e — te’ 
2cos2t + 2sin2t 
9. y(t) = cos 2t — sin 2t 
2cos2t + 2sin2t 


Bjon! 
ll. y(t 1+ 2e ne 


—2 + 2e~ cos 2t 


13. t 
y( 1 +e‘ sin2t — 2e cos2t 


=| 
— 2e~ cos 2t + 4e~ sin zl 
=| 


t ae ane 
15. y(t 2te’ +e’ —t 


—4te’ —e' +2 +2 


te! 
17. y(t)=| 2te? —e +e! 
—2te” + te! 


B_ Selected Answers 783 


19. y(t) =14 3e°7, yo(t) = 2+ 4e%* — Ge’, t = 9.02 seconds. 


21. y(t) = y2(t) = 1-e 


Section 9.6 
1 3 -] -10 1 ee 
1P= 1-il J=PVAP= oi, and the critical point is saddle. 


3. P= i al J= ls | and the origin is a stable spiral node. 


5. A is of type J3. The origin is an unstable star node. 


= 
as) 
II 


al J=P'AP= F a and the origin is an unstable node. 


9, P= E of J=P™"AP= E al and the origin is an unstable star node. 


Section 9.7 


2et <= e2! 
2e — 4e?! 
Hert ett (a grt a. a 


1. @(t) is a fundamental matrix, y(t) = I and the standard 


1 
fund. tal matrix att = Ois W(t) = = 
undamental matrix a is W(t) eee ee teiiett 


cos(t?/2) 
— sin(t?/2) 
cos(t?/2) sin(t?/2) 
— sin(t?/2) me 


3. @(t) is a fundamental matrix, y(t) = | and the standard 


fundamental matrix at t = 0 is W(t) = 


pT : 
5. @(t) is a fundamental matrix, y(t) = — none’ ae 
cost + sint 


, and the standard 
aa 
—tcost —fsin i 


1 
fundamental matrix at t = 7 is W(t) = — 


8 tsint —t cost 


784 


ce 


11. 


13. 
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(t — le’! —3 


@(t) is a fundamental matrix, y(t) = 143 
e 


| and the standard 


= t—-l (47 _ t-1 
fundamental matrix att = 1 is W(t) = a ee u De ; 
—-l+e! e! 1 
t—tlnt -tlnt 2t —tlInt 
©) poe ane yO) al 
W(t) = sec? + 3sect tant + tan? t¢ 5 sect tant 
_ —secttant sec?t —3sect tant + tan’? 


2sec?t + 11 sect tant + 2 tant 
sec? tf — 5sect¢ tant + tan? ¢ |’ 


y= 


n= 42-1) +2101) and yx(t) = 22-1 + 2-12 + 20-0) 


17 
The concentration (grams/L) of salt in Tank | after | min is ae and in Tank 2 
15 


is —. 


4 


Appendix C 
Tables 


C.1 Laplace Transforms 


Table C.1 Laplace transform rules 
f(t) F(s) Page 
Definition of the Laplace transform 


1 f(t) F(s) = fo? e—™ f(t) dt 111 
Linearity 

2,0 a fit) + ar f(t) a, F\(s) + a2 F2(s) 114 
Dilation principle 

3. fat) le (=) 122 

a a 

Translation principle 

4. e” f(t) F(s—a) 120 
Input derivative principle: first order 

5: tf’) sF(s) — f(0) 115 
Input derivative principle: second order 

6. f(t) s? F(s) — sf(0) — f’(0) 115 
Input derivative principle: nth order 

7. {™O s" F(s) — s"—! f(0) — s"~? f/(0) — +++ — 116 


sf) — f°) 


Transform derivative principle: first order 


8. tf(t) —F'(s) 121 
Transform derivative principle: second order 
9. tv? f(t) F’(s) 
Transform derivative principle: nth order 
10. ¢” f(t) (-1)" F™(s) 121 
Convolution principle 
ll. (f¥ Q0H=f fOgt—Ddt — F(s)G(s) 188 
Input integral principle 
F(s 
12. f} f()dv 9) 190 
Ss 
(continued) 
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786 C_ Tables 
Table C.1 (continued) 
f(t) F(s) Page 
Transform integral formula 
t 
13. mo [°° F(a) do 357 
t 
mm has a continuous extension to 0 
Second translation principle 
14. f(t —c)h(t —c) e * F(s) 405 
Corollary to the second translation principle 
15. g(t)h(t —c) e©L {g(t + c)}) 405 
Periodic functions 
P —st 
e t) dt 
16. f(0), foe" FO 455 
; 1—e-? 
periodic with period p 
t)— f(Hh(t — 
ie “san EFO= SOM DI sg 
—e S 
Staircase functions 
| Ea See aaron) ; 
18. Fly) ID 463 
I = 
Transforms involving ———— 
Tyan 68? 
co ON 
19. ~ YL fC =p) x wow +p) — F(s) 461 
N=0n=0 Leerv 
co N 1 
20. LLC" ft = np) xwe.w+np) a= Tne 461 
N=0n=0 +e 
Table C.2 Laplace transforms 
f(t) F(s) Page 
1 
1. 1 = 116 
Ss 
1 
2: t 52 
n!} 
3. t” (n=0, 2, 3,...) ari 116 
E 1 
4. t” (w>0) eat) 118 
set l 
1 
5 ev 118 
s—a 
6. te“! : 
(sa) 
; n!} 
he t"e' (n = 1, 2, 3,...) Goat 119 
b 
8. sin bt fa fi 118 
9. cos bt 118 


C.1 Laplace Transforms 


Table C.2 (continued) 
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Page 


10. e“' sin bt 


f(t) 
11. e” cos bt 
sint 
12. — 
it 
sinat 
13. 
et ett 
14. 
t 
cos bt — cosat 
15. ———_—_— 
t 
16. cos bt —cosat 
t2 


Laguerre polynomials 


17. ln(t) = Dkao(-D* (i) 
18. £, (at) 

The Heaviside function 

19. h(t —c) 

The on-off switch 

20. X{a.b) 

The Dirac delta function 

21. Se 

The square-wave function 

22% SWe 

The sawtooth function 

23. {t) 
Periodic dirac delta functions 

24. 50 ((t) p) 
Alternating periodic dirac delta functions 
25. (50 — 5p )((t) 2p) 

The matrix exponential 

26. eft 


F(s) 

a See 
(s —a)? + b? 
sca 
(s — a)? + b? 

_,1 
tan! — 


(s al 1)" 
gn 
(s—a)" 
girl 
e *¢ 
Ss 
eas eds 
5 5 
eo 
1 1 
Ite“ s 
1 spe *P 
Bice (iy eerie cet es, 
s2 l1—e—? 
1 
l-—e Ps 
1 
IT+e Ps 


120 
120 


358 
365 


365 


365 


365 


361 


366 


404 


405 


428 


456 


457 


459 


459 


459 
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Table C.3 Heaviside formulas 
f(t) F(s) 
Heaviside formulas of the first kind 
ett bt 1 
‘li. a nr) 
a-—b b-a (s —a)(s — b) 
; ae“ ae beb Ss 
. a-—b b-a (s — a)(s — b) 
eat elt ect 1 
3. 
(a—b)(a—c) (b-—a)(b-c) (c—a)(c—b) (s — a)(s — b)(s —c) 
4 ae be?! cet s 
. (a—b)(a—c) (b-—a)(b-c)  (c—a)(c—b) (s — a)(s — b)(s —c) 
azett bet cect g2 
> 
(a—b)\(a—c) (b-—a)(b-c) (c—a)(c—b) (s — a)(s — b)(s — c) 
rkent rk erat sk 
6. pees imal ; —_—______., 
qr) an) (= 71) (67) 
q(s) = (s —r1) ++: (8 — Ty) Frise a r,, distinct 
Heaviside formulas of the second kind 
1 
Te t at 
‘ (=a) 
8. (1 + atje” G=oF 
9 e at 1 
. ae (s —a)3 
to (24) eet . 
) a (s —a)3 
ue (14200 ¢ 2) eat : 
; . 2 (s —a)3 
ko (ky gk—1 _t'7"_*\ oat st 
12. (Sino (a a) e Gaor 


In each case, a, b, and c are distinct. See Page 165. 


Table C.4 Laplace transforms involving irreducible quadratics 


£0 


1. sinbt 


1 
2. ap? (sin bt — bt cos bt) 


3: a (B — (bt)*) sin bt — 3bt cos bt) 

4. aie ((15 — 6(br)) sin bt — (15bt — (bt)+) cos bt) 
5. cosbt 

6. =aht sin bt 

7. ori (bt sin bt — (bt)? cos bt) 

8. “aie ((3bt — (bt)*) sin bt — 3(bt)* cos bt) 


F(s) 
b 


b 


(s 7 ) 
b 
AY 
S 
S 


(s2 + b2)3 
s 


C.2 Convolutions 789 
Table C.5 Reduction of order formulas 
co 1 ee co s _ 2k — Lat 1 
(s2 + b2)k+1 2kb? (s? + b2)k§ © 2kb? (s? + b2)k 
co Ss st co 1 
(s2 + b2)k+1 2k (s2 + b2)k 
See Page 155. 
Table C.6 Laplace transforms involving quadratics 
St) F(s) Page 
Laplace transforms involving the quadratic s? + b* 
k 
sinbt Led ak 2b)?" 
1. —1)”" - 
Bye Leg EY Get 
k=1 
cosbt L*z'] — omy 2bt)2"4! b 
= 2k xe (-1)” - ') 2 2)k+1 549 
(2b)** = n=0 (2m + 1)! (s? + b?) 
2bt sin bt Le (ayn ean—2y (2b)? 
k + (2b)* m=o kl" (2m)! 
2bt cosbt LZ J 2k—Im—3) (2b1)2"+! s 
k- (2b)?* , (-1) ( k-1 ) Qm+))! (s2 + b2)k+1 549 
Laplace transforms involving the quadratic s? — b? 
(-1I)k & (2k—n)! = 1 
3: 2t)"e' — (2t)"e* 553 
EFI & nik —nyl © 2% ee) (s? — FI 
(lt £& @k-n—-1)! 7 Ss 
4. 2ty"el + (21)"e* 553 
Uh = Gea oe (s2 — NF 
C.2 Convolutions 
Table C.7 Convolutions 
f(t) g(t) (f * gs) Page 
L fo) g(t) f* 8) = fy fe —w) du 187 
2. 1 g(t) if g(t) dt 190 
m n min! m+n+l 
3. t t epee” 193 
4. t sinat — 
> 4 
5. t? sinat a (cos at — (1 ary) 
6. t cos at ests 
aa 
7. t? cosat = (at — sinat) 
@Z 


(continued) 
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Table C.7 (continued) 


fO) 


(f * g)() 
e” —(1 +at) 
a 
ae" -G@tat Fs) 
; ! (e —e") a # b 
teu 
1 
Tp (be“’ — bcos bt — asin bt) 
Ao 
; pz ae" acos bt + bsinbt) 
Ao 


1 
pug? sinat—asinbt) a¥#b 
—a 


1 
—(sinat — at cosat) 
2a 


z(acosat—acosbt) a #b 
a 


pee 

1, 
<t sinat 

2 - (asinat—bsinbt) a#b 
re 

1 
5g tt cost + sinat) 

a 


f(t— h(t —c) 
f(t) 
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Page 


192 
192 
195 


195 
195 
195 
195 


195 
195 


195 


444 
445 


Symbol Index 


By standard basis of Ey 

ca(s) characteristic polynomial of A 

X{a,b) Characteristic function or on-off switch 

C complex numbers 

dee approximation to the Dirac delta function 
D derivative operator 

de(t) Dirac delta function 

E linear space of exponential polynomials 
ef matrix exponential 


q 
F a generic linear space of functions 
Fret net force acting on a body 

f(t) — forcing function 

F(s) Laplace transform of f(t) 

f «gf convolved with g 

f** convolution of f, k times 

H Heaviside class 

h(t —c) translate of the Heaviside function 
h(t) Heaviside function 


L differential operator 

L The Laplace transform 
L{f(t)} Laplace transform of f(t) 

can Laguerre polynomial of order n 


ja inverse Laplace transform 

L'{F(s)} inverse Laplace transform of F(s) 
NS(A) null space of A 

@®(t) fundamental matrix 

W(t) standard fundamental matrix 

Q rational numbers 

q(D) _ polynomial differential operator 
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exponential polynomials whose Laplace transform is in R, 
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Real numbers 

rational functions with g in the denominator 
generic spanning set 

square wave function 

Chebyshev polynomial 

Stair case function on intervals of length p 
sawtooth function with period p 

Chebyshev polynomial 


...> Jn) Wronskian matrix of fi..., fh 
..., fn) Wronskian 


generic unknown function to a differential system 
generic unknown function in a differential equation 
general solution to a differential equation 
homogeneous solution for a linear differential system 
homogeneous solution to a linear differential equation 
particular solution for a linear differential system 
particular solution to a linear differential equation 


C Symbol Index 


Index 


A 
Abel’s formula 
nth-order, 288 
second order, 233, 344 
absolute convergence, 489 
acceleration, 256 
adjoint, 610 
adjoint inversion formula, 611 
affine equivalence, 681 
affine transformation, 681 
algorithm 
description of B,, 182 
exact equations, 75 
first order linear equations, 47 
Fulmer’s method for e“’, 660 
Gauss-Jordon, 581 
incomplete partial fraction method 
nth-order, 296 
Laplace transform method, 107 
method of undetermined coefficients 
nth-order, 295 
second order, 239 
partial fraction 
linear recursion, 131 
quadratic recursion, 145 
Picard Approximation, 87 
separable differential equation, 29 
solution method for nth order linear 
differential equations, 279 
solution method for nth order homogeneous 
linear equations, 286 
solution method for constant coefficient 
first order system, 673 
solution method for coupled systems, 304 
solution method for second order 


homogeneous differential equations, 
231 


solution method for second order linear 


differential equations, 209 
amplitude, 258 
analytic at fo, 498 
annihilation operator, 363 


associated homogeneous differential equation, 


53, 208, 279, 633 
associated homogeneous system, 571 
asymptotically stable, 318 
augmented matrix, 570 
autonomous, 28 


B 
back substitution, 574 
balance equation, 630 
basis, 217 
beats, 263, 326, 477, 481 
Bernoulli equation, 66 
Bernoulli, Jakoub, 66 
Bessel function of order 0, 490 
Bessel’s differential equation, 331 
Bounded Input Bounded Output, 323 
By 
definition, 180 
linear independence, 221, 730 


Cc 
canonical phase portraits, 694 
Cardano’s formula, 32 
Cardano, Girolamo, 32 
carrying capacity, 37 
Cauchy-Euler 
equation, 349 
fundamental set, 351 
operator, 349 
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Cayley-Hamilton theorem, 688, 733 
center, 489, 696 
chain, 130 
characteristic equation, 621 
characteristic frequency, 324 
characteristic function, 402 
characteristic matrix, 621 
characteristic modes, 316 
characteristic polynomial, 167, 205, 
621, 652 
characteristic values, 316, 652 
Chebyshev polynomials, 510 
Chebyshev’s differential equation, 331,513 
xla, b), 402 
Clairaut’s theorem, 74 
Clairaut, Alexis, 74 
closed form, 496 
coefficient function, 45, 203, 331 
coefficient matrix, 569 
cofactor, 610 
column expansion, 606 
completing the square, 726 
consistent, 569 
constant coefficient linear differential equation 
second order, 205 
constant coefficient system, 633 
constant function, 116 
continuous function, 45, 86 
convolution, 187, 439 
properties, 189 
theorem, 188, 262, 441 
coupled spring systems, 305 
coupled system, 276 
Cramer’s rule, 374, 613 
creation operator, 363 
critical point, 693 
critically damped system, 261 
current, 267 


D 
damped free motion, 259 
damped motion, 258 
damping constant, 255 
damping force, 254 
damping term, 259 
dee, 427 
decay constant, 33 
dependent variable, 4, 579 
D, 205 
derivative operator, 205, 277 
determinant 
definition: 2 x 2 case, 605 
definition: general case, 605 


elementary row operations, 607 
properties, 607 


differential equation 


autonomous, 28 
Bernoulli, 66 
Chebyshev, 513 
constant coefficient 
nth-order, 277 
second order, 205 
dependent variable, 4 


discontinuous forcing function, 389 


equilibrium solution, 18 
exact, 73 
family of curves, 21 
first order solution curve, 17 
general solution, 5 
geoemetric interpretation, 97 
homogeneous, 208, 277 
homogenous, 63 
second order, 333 
independent variable, 4 
initial value problem, 203, 232 
integrating factor, 46 
exact equation, 79 
linear, 45 
coefficient function, 45 
constant coefficient, 45 
forcing function, 45 
general solution, 53 
homogeneous, 45 
homogeneous solution, 53 
inhomogeneous, 45 
initial value problem, 50 
particular solution, 53 
standard form, 45, 333 
logistic, 37 
nonhomogeneous, 277 
order, 3 
ordinary, 2 
partial, 4 
second order linear 
initial conditions, 203 
separable, 27 
differential form, 29 
solution, 5 
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solution method for nth order homogeneous 


linear equations, 286 


solution method for nth order linear 


differential equations, 279 


solution method for constant coefficient 


first order system, 673 


solution method for second order 


homogeneous linear equations, 
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solution method for second order linear 
differential equations, 209 

solution method for separable, 29 
solution of first order linear, 47, 666 
standard form, 3 
Verhulst equation, 37 

differential system 
associated homogeneous equation, 667 
associated homogeneous system, 704 
coupled system, 301 
general solution, 667 
homogeneous solution, 634, 667 
particular solution, 667 
solution, 634 

dilation, 122 

dilation principle, 122 

5¢, 428 

Dirac delta function, 427 

direction field, 17 
trajectories, 18 

discriminant, 259 

displacement, 253 

distributions, 428 


E 
echelon form, 578 
eigenspace, 620 
eigenvalue, 619 
eigenvalues, 652 
eigenvector, 619 
elementary equation operations, 573 
elementary matrix, 594 
elementary row operations, 574 
notation, 574 
English system, 256 
Eq, 168 
description 
degree 2, 169 
power of a linear term, 174 
power of an irreducible quadratic term, 175 
spanning set, 171 
equality of mixed partial derivatives, 74 
equilibrium, 19 
equilibrium line, 18 
equilibrium solution, 18, 693 
equivalent, 572 
essentially equal, 407 
exactness criterion, 75 
existence and uniqueness, 85 
general systems, 703 
systems, 666 
existence and uniqueness theorem, 703 
nth order differential equation, 675 
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nth-order, 280 

Picard, 89 

second order, 211 

non constant coefficients, 336 

e’, 649 
exponential function, 118 
exponential polynomial, 179 

simple, 179 
exponential type, 112, 126, 355, 

746 

exponents of singularity, 521 
external force, 255 


F 
final value principle, 356 
first translation principle, 120 
fixed point, 87 
Fomin, S. V., 93 
force of gravity, 253 
forced motion, 258 
forcing function, 45, 203, 333 
formal Laplace transform method, 432 
free motion, 258 
free variable, 575, 579 
frequency, 258, 477 
Frobenius method, 519, 521 
Frobenius series, 520 

solution, 521 
F(s), 111 
f * g, 439 
Fulmer’s method, 657, 660 
Fulmer, Edward P., 657 
functional equation, 5 
functional identity, 5 
fundamental interval, 453 
fundamental matrix, 706 
fundamental period, 453 
fundamental set, 345, 373 
fundamental theorem of algebra, 726 
fundamental theorem of calculus, 8 


G 

gamma function, 117, 126 
Gauss-Jordan elimination method, 581 
Gauss-Jordon elimination, 582 
Gaussian elimination, 582 

general power function, 118 

general solution, 53 

generalized factorial function, 117 
generalized functions, 428 
gravitational force, 256 
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H 
H, 399 
h(t), 401 
h(t —c), 401 
half-life, 33 
Heaviside class, 399 
Heaviside formulas 

first kind, 165 

second kind, 165 
Heaviside function, 401, 404 
Hermite’s differential equation, 331 
homogeneous, 64, 570 
homogeneous differential equation, 63 
homogeneous of degree , 64 
homogeneous solution, 53, 209, 634, 711 
homogeneous system, 633 


I 

improper node, 695 

impulse functions, 433 

incomplete partial fraction method, 245, 295 

inconsistent, 569 

independent variable, 4 

index shift, 491 

indicial polynomial, 350, 521 
conjugate complex roots, 351 
distinct real roots, 350 
double root, 350 

initial conditions, 203, 210, 280, 335 

initial state, 315 

initial value principle, 356 

initial value problem, 9, 50, 210, 280, 335, 638 
second order, 203 

initial values 
not based at the origin, 211 

input derivative principle, 115, 416 

input function, 111 

input integral principle, 417 

input-output rate, 54 

integral equation, 86 

integrating factor, 46, 48 
exact equation, 79 

interval of convergence, 489 

inverse (of a matrix), 593 

inverse Laplace transform, 151 
definition, 151 
first translation principle, 152 
linearity, 152 
reduction of order formula, 155 
second translation principle, 405 
uniquenss, 407 

inversion formulas involving irreducible 

quadratics, 158 


irreducible quadratic, 539, 726 
irregular singular point, 519 


J 

Jordan canonical forms, 687 
Jordan matrix, 688 

jump, 385 

jump discontinuity, 385 


K 
Kolmogorov, A. N., 93 


L 

£,, 361 

Laguerre polynomial, 361 

Laguerre’s differential equation, 331, 361 

Laplace expansion formula, 605 

Laplace transform, 101, 111 
constant function, 116 
convolution theorem, 188 
correspondences, 183 
cosine function, 118 
dilation principle, 122 
exponential functions, 118 
final value principle, 356 
first translation principle, 120 
general power functions, 118 
initial value principle, 356 
injective, 723 
input derivative principle, 115, 416 
input integral principle, 190, 417 
inverse, 151 
linearity, 114 
power functions, 116 
Power-Exponential Functions, 119 
second translation principle, 405 
sine function, 118 
transform derivative principle, 121 
transform integral principle, 357 

Laplace transform method, 104 
coupled systems, 310 
formal, 432 

law of radioactive decay, 2 

leading one, 578 

leading variables, 579 

left inverse, 593 

Legendre’s differential equation, 331 

length, 130 

linear, 206, 571 

linear combination, 171 

linear conbination 
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solving equations, 220 identity, 560 
linear dependence inverse, 593 

summary, 224 inversion computations, 597 
linear differential operator invertible, 593 

second order, 334 Jordan, 688 
linear equation, 569 lower triangular, 560 
linear homogeneous system main diagonal, 559 

fundamental matrix, 706 minor, 605 
linear independence product, 564 

restriction to subintervals, 222 rank, 579 

summary, 224 real, 560 
linear independence of B,, 221 resolvent, 652 
linear space, 112 row matrix, 563 
linear substitutions, 69 row vector, 563 
linear system of ordinary differential equations, scalar multiplication, 562 

633 similar, 682 

linear term, 726 size, 559 
linearity square, 559 

Laplace transform, 114 standard fundamental, 706 
linearly dependent, 217, 341 transpose, 561 

vectors in IR", 585 upper triangular, 560 
linearly independent, 217, 341 variable, 569 

vectors in IR”, 585 vector product, 563 
Lipschitz condition, 95 zero, 560 
logistic differential equation, 37 matrix exponential, 649, 732 
logistic equation, 39 matrix function 
logistic growth law, 13, 37, 43, 741 antiderivative, 640 
£,111 continuous, 639 
£051 differentiable, 639 


inverse Laplace transform, 641 
Laplace transform, 640 


M method of successive approximations, 87 
Malthusian growth law, 13, 36, 43, 741 method of undetermined coefficients 
Malthusian parameter, 36, 37 nth-order, 293 
Maple, 17 second order, 237 
marginally stable, 318 metric system, 256 
mass, 256 mixing problem, 54, 59, 419 
Mathematica, 17 input-output rate, 54 
mathematical model, 313 
MATLAB, 17 
matrix, 559 N 
addition, 561 Newton, 256 
adjoint, 610 Newton’s law of heating and cooling, 1, 34, 42, 
augmented, 570 741 
characteristic equation, 621 Newton’s second law of motion, 2, 255 
characteristic polynomial, 621, 652 nonhomogeneous, 570 
coefficient, 569 nonhomogeneous system, 633 
cofactor, 610 nonsingular, 593 
column matrix, 563 null space, 570 


column vector, 563 

commute, 565 

completing the square, 726 O 

complex, 560 on-off switch, 402, 405 
diagonal, 560 orbit, 681 
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ordinary point, 505 
output function, 111 
output matrix, 569 
overdamped system, 261 


P 
partial fraction, 129 
(s — r)-chain, 130 
(s? + cs + d)-chain, 144 
chain, 130 
distinct linear factors, 135 
Laplace transform method, 136, 148, 160 
length, 130 
linear recursion, 130 
linear recursion algorithm, 131 
quadratic recursion, 143 
quadratic recursion algorithm, 145 
particular solution, 53, 711 
path, 681 
Peano’s existence theorem, 93 
Peano, Guiseppe, 93 
period, 258, 453 
periodic function, 453 
phase angle, 258 
phase plane, 681 
phase portrait, 681 
canonical, 694 
phase-amplitude form, 258 
Picard, Emile, 87 
piecewise continuous, 385, 399 
pointwise convergence, 90 
polynomial 
coefficients, 725 
irreducible quadratic, 726 
leading coefficient, 725 
linear term, 726 
root, 725 
polynomial differential operator, 205, 277 
commutativity, 301 
polynomial of degree n, 725 
power function, 116 
power series, 489 
absolute convergence, 489 
analytic, 498 
center, 489 
centered at fo, 489 
closed form, 496 
coefficients, 489 
differential equation 
standard form, 519 
even function, 495 
index shift, 491 
interval of convergence, 489 
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method, 487, 506 

odd function, 495 

ordinary point, 505 

radius of convergence, 489 

ratio test, 489 

representation, 490 

singular point, 505 

standard form, 492 
power-exponential functions, 119 
proper rational function, 129 


q(D), 205 


radioactive decay, 42, 741 
decay constant, 33 
half-life, 33 

radius of convergence, 489 

rank, 579 

Rate in - Rate out, 630 

ratio test, 489 

rational function, 129, 499, 727 
proper, 129 
simple, 153 

RCL circuits 
current, 267 

rectified sine wave, 454 

recurrence relation, 506 

reduced matrix, 578 

reduction of order, 367 
inverse Laplace transform, 155 

regular singular point, 519 

resolvent matrix, 652 

resonance, 264, 324, 478, 481 
asymptotically stable, 327 

restoring force, 254 

Riccati equation, 91 

right continuous, 408 

right inverse, 593 

root, 725 

row echelon form, 578 

row expansion, 606 

row reduced echelon form, 578 

row reduces, 579 

Ry, 168 


Ny 

saddle, 694 

sawtooth function, 453 

second translation principle, 405 


Index 799 


separable differential equation, 27 total impulse, 434 

separable variables, 27 total response, 315 

sign matrix, 606 [t]p, 454 

similar, 682 (t) p, 453 

Simmons, G.F., 89 trajectories, 18, 681 

simple exponential polynomials, 179 transform derivative principle, 121 
simple harmonic motion, 258 transform function, 111 

simple rational function, 153 transform integral principle, 357 


singular, 593 
singular point, 505 


sliding window, 440 U 

slope field, see direction field U,,, 511 

slug, 256 undamped forced motion, 262 

solution, 569, 634 undamped free motion, 258 
exists, 85 undamped motion, 258 
unique, 85 periodic impulses, 478 
zero-state, 446 periodic input, 473 

solution set, 569 underdamped system, 260 

span, 171 uniform convergence, 90 

spanning set, 171 unit impulse response function, 315, 319, 445 

special functions, 331 unit step function, 401 

spring constant, 254 units of measurement, 256 

spring-body-mass system, 253 unstable, 318, 695 

square-wave function, 456 unstable node, 694 

SWe, 456 unstable spiral node, 696 

stability, 318 unstable star node, 695 

stable, 695 

stable node, 694 

stable spiral node, 696 Vv 


stable star node, 695 
staircase function, 454 
standard basis, 171 
standard fundamental matrix, 706 
star node, 695 
summary 
classification of critical points, 697 
linear dependence, 224 
linear independence, 224 
superposition principle, 241 
linear systems, 637 
system diagram, 313 
system of linear equations, 569 


variable matrix, 569 

variation of parameters, 373 
vector space, 112 

Verhulst population equation, 37 


Ww 

Weierstrass approximation theorem, 723 
Widder, David, 111 

Wronskian, 222, 343 

Wronskian matrix, 222, 343, 374 


Z 
T zero-input response, 315 
Taylor Series, 498 zero-input solution, 446 
test function, 237, 239, 293 zero-state, 446 
T,, S11 zero-state response, 315 


Torricelli’s law, 13 zero-state solution, 446 


